Sep 11 22:54:26 devstack cinder-volume[76629]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 22:54:26 devstack cinder-volume[76629]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 22:54:26 devstack cinder-volume[76629]: we strongly recommend against using it for new projects. Sep 11 22:54:26 devstack cinder-volume[76629]: If you are already using Eventlet, we recommend migrating to a different Sep 11 22:54:26 devstack cinder-volume[76629]: framework. For more detail see Sep 11 22:54:26 devstack cinder-volume[76629]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 22:54:26 devstack cinder-volume[76629]: import eventlet # noqa Sep 11 22:54:29 devstack cinder-volume[76629]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:54:29 devstack cinder-volume[76629]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:54:29 devstack cinder-volume[76629]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:54:30 devstack cinder-volume[76629]: INFO dbcounter [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Registered counter for database cinder Sep 11 22:54:30 devstack cinder-volume[76629]: DEBUG oslo_db.sqlalchemy.engines [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:54:30 devstack cinder-volume[76629]: DEBUG dbcounter [-] [76629] Writer thread running {{(pid=76629) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:54:30 devstack cinder-volume[76629]: INFO cinder.rpc [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 22:54:30 devstack cinder-volume[76629]: INFO cinder.rpc [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 22:54:30 devstack cinder-volume[76629]: DEBUG oslo_db.sqlalchemy.engines [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:54:31 devstack cinder-volume[76629]: INFO cinder.volume.manager [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Determined volume DB was empty at startup. Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG cinder.volume.manager [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76629) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 22:54:31 devstack cinder-volume[76629]: INFO cinder.volume.manager [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 11 22:54:31 devstack cinder-volume[76629]: WARNING stevedore.named [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 22:54:31 devstack cinder-volume[76629]: WARNING castellan.key_manager [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:54:31 devstack cinder-volume[76629]: WARNING cinder.keymgr.conf_key_mgr [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG cinder.volume.drivers.lvm [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76629) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_concurrency.processutils [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_concurrency.processutils [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] CMD "cinder-rtstool verify" returned: 0 in 0.515s {{(pid=76629) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_db.sqlalchemy.engines [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:54:31 devstack cinder-volume[76629]: INFO cinder.rpc [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 11 22:54:31 devstack cinder-volume[76629]: INFO cinder.rpc [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 11 22:54:31 devstack cinder-volume[76629]: WARNING stevedore.named [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 22:54:31 devstack cinder-volume[76629]: WARNING castellan.key_manager [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:54:31 devstack cinder-volume[76629]: INFO cinder.volume.manager [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_db.sqlalchemy.engines [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:54:31 devstack cinder-volume[76629]: INFO oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Starting 1 workers Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Started child 76789 {{(pid=76629) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Full set of CONF: {{(pid=76629) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] ******************************************************************************** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Configuration options gathered from: {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] ================================================================================ {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] allow_availability_zone_fallback = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] allow_compression_on_image_upload = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] allowed_direct_url_schemes = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] api_rate_limit = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76789]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] auth_strategy = keystone {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] az_cache_duration = 3600 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_availability_zone = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_host = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_stats_polling_interval = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backup_api_class = cinder.backup.api.API {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backup_name_template = backup-%s {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backup_use_same_host = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backup_use_temp_snapshot = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] chap_password = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] chap_username = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_internal_tenant_project_id = 4509e7bb950947699fe2fb77889e9622 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_internal_tenant_user_id = b5a17997241c4674b102b53447480d39 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cloned_volume_same_az = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cluster = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] compression_format = gzip {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] compute_api_class = cinder.compute.nova.API {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] config_dir = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] config_source = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] control_exchange = openstack {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] debug = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] default_availability_zone = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] default_group_type = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] default_volume_type = lvmdriver-1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] disk_geometry = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] driver_client_cert = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] driver_client_cert_key = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] driver_data_namespace = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] driver_ssl_cert_path = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] driver_ssl_cert_verify = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] driver_use_ssl = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] enable_force_upload = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] enable_new_services = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] enable_unsupported_driver = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] enforce_multipath_for_image_xfer = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] filter_function = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_api_insecure = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_api_ssl_compression = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_ca_certificates_file = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_catalog_info = image:glance:publicURL {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_certfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_keyfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_num_retries = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance_request_timeout = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] goodness_function = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] graceful_shutdown_timeout = 5 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] group_api_class = cinder.group.api.API {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] host = devstack {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_compress_on_upload = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_conversion_address_space_limit = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_conversion_cpu_limit = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_conversion_disable = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_introspection_address_space_limit = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_introspection_cpu_limit = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_upload_use_cinder_backend = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_upload_use_internal_tenant = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_volume_cache_enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_volume_cache_max_count = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] image_volume_cache_max_size_gb = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] init_host_max_objects_retrieval = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] instance_format = [instance: %(uuid)s] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] iscsi_target_flags = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] iscsi_write_cache = on {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] iser_helper = tgtadm {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76789]: INFO cinder.volume.manager [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] iser_ip_address = 192.168.122.110 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] iser_port = 3260 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_color = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_config_append = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_dir = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_file = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_options = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_rotate_interval = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_rotate_interval_type = days {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] log_rotation_type = none {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] max_age = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] max_logfile_count = 30 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] max_logfile_size_mb = 200 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] max_over_subscription_ratio = 20.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] message_reap_interval = 86400 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] message_ttl = 2592000 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] migration_create_volume_timeout_secs = 300 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] monkey_patch = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] monkey_patch_modules = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] my_ip = 192.168.122.110 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] no_snapshot_gb_quota = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] num_iser_scan_tries = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] num_shell_tries = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] num_volume_device_scan_tries = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] nvmeof_conn_info_version = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] nvmet_ns_id = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] nvmet_port_id = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] osapi_max_limit = 1000 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] osapi_volume_ext_list = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] osapi_volume_listen_port = 8776 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] osapi_volume_use_ssl = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] osapi_volume_workers = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] per_volume_size_limit = -1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] periodic_fuzzy_delay = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] periodic_interval = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] public_endpoint = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] publish_errors = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] quota_backup_gigabytes = 1000 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] quota_backups = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] quota_gigabytes = 1000 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] quota_groups = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] quota_snapshots = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] quota_volumes = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] rate_limit_burst = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] rate_limit_except_level = CRITICAL {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] rate_limit_interval = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] reinit_driver_count = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] replication_device = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] report_discard_supported = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] report_interval = 120 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] reservation_clean_interval = 86400 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] reservation_expire = 86400 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] reserved_image_namespaces = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] reserved_percentage = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] rpc_response_timeout = 120 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] run_external_periodic_tasks = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] scst_target_driver = iscsi {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] scst_target_iqn_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_down_time = 720 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] shell_completion = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] snapshot_name_template = snapshot-%s {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] snapshot_same_host = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] split_loggers = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] state_path = /opt/stack/data/cinder {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] storage_availability_zone = nova {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] storage_protocol = iSCSI {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] syslog_log_facility = LOG_USER {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] target_helper = lioadm {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] target_ip_address = 192.168.122.110 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] target_port = 3260 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] target_protocol = iscsi {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] target_secondary_ip_addresses = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] trace_flags = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] transport_url = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] until_refresh = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] use_chap_auth = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] use_default_quota_class = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] use_journal = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] use_json = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] use_multipath_for_image_xfer = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] use_stderr = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] use_syslog = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] verify_glance_signatures = enabled {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_api_class = cinder.volume.api.API {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_backend_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_clear = zero {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_clear_ionice = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_clear_size = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:31 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_copy_bps_limit = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_dd_blocksize = 1M {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_name_template = volume-%s {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_service_inithost_offload = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volume_usage_audit_period = month {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] zoning_mode = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_concurrency.disable_process_locking = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.auth_section = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.auth_type = password {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.auth_version = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.cache = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.certfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.include_service_catalog = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.insecure = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.interface = public {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.keyfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_password = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcache_username = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.region_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.service_type = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.backend = dogpile.cache.null {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.backend_argument = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.backend_expiration_time = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.config_prefix = cache.oslo {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.debug_cache_backend = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.enable_retry_client = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.enable_socket_keepalive = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.expiration_time = 600 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.hashclient_retry_attempts = 2 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.memcache_dead_retry = 300 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.memcache_pool_maxsize = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.memcache_sasl_enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.password = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.proxies = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.redis_db = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.redis_server = localhost:6379 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.retry_attempts = 2 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.retry_delay = 0.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.socket_keepalive_count = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.socket_keepalive_idle = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.socket_keepalive_interval = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.socket_timeout = 1.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.tls_allowed_ciphers = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.tls_cafile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.tls_certfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.tls_enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.tls_keyfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cache.username = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] coordination.backend_url = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.asyncio_connection = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.asyncio_slave_connection = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.backend = sqlalchemy {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.connection = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.connection_debug = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.connection_parameters = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.connection_recycle_time = 3600 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.connection_trace = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.db_inc_retry_interval = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.db_max_retries = 20 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.db_max_retry_interval = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.db_retry_interval = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.max_overflow = 50 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.max_pool_size = 5 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.max_retries = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.mysql_wsrep_sync_wait = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.pool_timeout = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.retry_interval = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.slave_connection = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.sqlite_synchronous = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.synchronous_reader = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] database.use_db_reconnect = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 11 22:54:32 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_tracing.insecure = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.connection_string = messaging:// {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.es_doc_type = notification {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.es_scroll_size = 10000 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.es_scroll_time = 2m {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.filter_error_trace = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.hmac_keys = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.sentinel_service_name = mymaster {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.socket_timeout = 0.1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.trace_requests = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler.trace_sqlalchemy = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler_jaeger.process_tags = {} {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler_jaeger.service_name_prefix = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] profiler_otlp.service_name_prefix = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.enforce_new_defaults = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.policy_default_rule = default {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.policy_file = policy.yaml {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] privsep_osbrick.group = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] privsep_osbrick.helper_command = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] privsep_osbrick.user = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_sys_admin.group = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_sys_admin.helper_command = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] cinder_sys_admin.user = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.auth_section = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.auth_type = password {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.cafile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.certfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.collect_timing = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.insecure = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.keyfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.send_service_user_token = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.split_loggers = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.timeout = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.tls_ciphers = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] service_user.tls_min_version = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.auth_section = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.auth_type = password {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.certfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.collect_timing = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.insecure = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.keyfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.region_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.split_loggers = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.timeout = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.tls_ciphers = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] glance.tls_min_version = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.backend_availability_zone = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.chap_password = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.chap_username = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.disk_geometry = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.driver_client_cert = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.driver_client_cert_key = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.driver_data_namespace = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.driver_use_ssl = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.extra_capabilities = {} {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.filter_function = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.goodness_function = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.iscsi_target_flags = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.iscsi_write_cache = on {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.iser_helper = tgtadm {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.iser_port = 3260 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.lvm_share_target = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.lvm_type = auto {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.num_shell_tries = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.replication_device = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.report_discard_supported = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.reserved_percentage = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.target_helper = tgtadm {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.target_port = 3260 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.target_protocol = iscsi {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.trace_flags = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.unique_fqdn_network = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.use_chap_auth = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_backend_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_clear = zero {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_clear_ionice = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_clear_size = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_reports.file_event_handler = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_reports.log_dir = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.backend_host = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.chap_password = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.chap_username = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.disk_geometry = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.driver_client_cert = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.extra_capabilities = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.filter_function = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.goodness_function = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.iser_helper = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.iser_ip_address = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.iser_port = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.lvm_share_target = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.lvm_type = auto {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.num_shell_tries = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.replication_device = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.report_discard_supported = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.reserved_percentage = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.scst_target_driver = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.storage_protocol = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.target_helper = lioadm {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.target_ip_address = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.target_port = 3260 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.trace_flags = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.use_chap_auth = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_clear = zero {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_clear_size = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] lvmdriver-1.volumes_dir = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.ssl = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_notifications.driver = [] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_notifications.retry = -1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] key_manager.fixed_key = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.barbican_api_version = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.barbican_endpoint = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.barbican_endpoint_type = public {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.barbican_region_name = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.cafile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.certfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.collect_timing = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.insecure = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.keyfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.number_of_retries = 60 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.retry_delay = 1 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.send_service_user_token = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.split_loggers = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.timeout = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.tls_ciphers = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.tls_min_version = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.verify_ssl = True {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican.verify_ssl_path = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.auth_section = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.auth_type = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.cafile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.certfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.collect_timing = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.insecure = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.keyfile = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.split_loggers = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.timeout = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.tls_ciphers = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] barbican_service_user.tls_min_version = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.approle_role_id = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.approle_secret_id = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.auth_method = approle {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.auth_path = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.kv_mountpoint = secret {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.kv_path = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.kv_version = 2 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.namespace = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.root_token_id = **** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.ssl_ca_crt_file = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.timeout = 60.0 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.token_file = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.token_role = None {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.use_ssl = False {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:54:32 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] ******************************************************************************** {{(pid=76629) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 22:54:32 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.363s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:32 devstack sudo[76917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:32 devstack sudo[76917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:32 devstack sudo[76917]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.291s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 22:54:32 devstack cinder-volume[76789]: INFO cinder.brick.local_dev.lvm [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:32 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:32 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:32 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG cinder.brick.local_dev.lvm [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76789) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 11 22:54:32 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:33 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:33 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:33 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:33 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:33 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:33 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:33 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:33 devstack sudo[77370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:33 devstack sudo[77370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:33 devstack sudo[77370]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:33 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:33 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:33 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:33 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:33 devstack sudo[77400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 11 22:54:33 devstack sudo[77400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:34 devstack sudo[77400]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:34 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.320s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:34 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:34 devstack sudo[77484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:34 devstack sudo[77484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:34 devstack sudo[77484]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:34 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:34 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:34 devstack sudo[77487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:34 devstack sudo[77487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:34 devstack sudo[77487]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:34 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:34 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:34 devstack sudo[77522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:34 devstack sudo[77522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:35 devstack sudo[77522]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:35 devstack sudo[77580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:35 devstack sudo[77580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:35 devstack sudo[77580]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:35 devstack sudo[77590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:35 devstack sudo[77590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:35 devstack sudo[77590]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:35 devstack cinder-volume[76789]: INFO cinder.volume.drivers.lvm [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:35 devstack sudo[77594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:35 devstack sudo[77594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:35 devstack sudo[77594]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG cinder.volume.drivers.lvm [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Updating volume stats {{(pid=76789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:54:35 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:35 devstack sudo[77597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:35 devstack sudo[77597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:36 devstack sudo[77597]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:36 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:36 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:36 devstack sudo[77600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:36 devstack sudo[77600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:36 devstack sudo[77600]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:36 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:36 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:36 devstack sudo[77603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:36 devstack sudo[77603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:36 devstack sudo[77603]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:36 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:36 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:36 devstack sudo[77606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:36 devstack sudo[77606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:36 devstack sudo[77606]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:36 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:36 devstack cinder-volume[76789]: INFO cinder.volume.driver [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Driver hasn't implemented _init_vendor_properties() Sep 11 22:54:36 devstack cinder-volume[76789]: DEBUG cinder.volume.driver [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76789) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG oslo_db.sqlalchemy.engines [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG dbcounter [-] [76789] Writer thread running {{(pid=76789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG cinder.db.api [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Building query based on filter {{(pid=76789) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG cinder.image.image_utils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76789) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 22:54:37 devstack cinder-volume[76789]: INFO cinder.keymgr.migration [None req-7888bd6c-b3e1-497c-b8c9-381f17ceeec3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG cinder.volume.drivers.lvm [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Updating volume stats {{(pid=76789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:37 devstack sudo[77611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:37 devstack sudo[77611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:37 devstack sudo[77611]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:37 devstack sudo[77614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:37 devstack sudo[77614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:37 devstack sudo[77614]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:37 devstack sudo[77618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:37 devstack sudo[77618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:37 devstack sudo[77618]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:37 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:37 devstack sudo[77621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:37 devstack sudo[77621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:38 devstack sudo[77621]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG cinder.manager [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Notifying Schedulers of capabilities ... {{(pid=76789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:54:38 devstack cinder-volume[76789]: INFO cinder.volume.manager [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Driver initialization completed successfully. Sep 11 22:54:38 devstack cinder-volume[76789]: INFO cinder.manager [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Initiating service 2 cleanup Sep 11 22:54:38 devstack cinder-volume[76789]: INFO cinder.manager [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Service 2 cleanup completed. Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG cinder.service [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Creating RPC server for service cinder-volume {{(pid=76789) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG cinder.service [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76789) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 22:54:38 devstack cinder-volume[76789]: INFO cinder.volume.manager [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG cinder.volume.drivers.lvm [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Updating volume stats {{(pid=76789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:38 devstack sudo[77626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:54:38 devstack sudo[77626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:38 devstack sudo[77626]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:38 devstack sudo[77632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:38 devstack sudo[77632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:38 devstack sudo[77632]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:38 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:38 devstack sudo[77635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:54:38 devstack sudo[77635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:39 devstack sudo[77635]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:39 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:39 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:54:39 devstack sudo[77638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:54:39 devstack sudo[77638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:54:39 devstack sudo[77638]: pam_unix(sudo:session): session closed for user root Sep 11 22:54:39 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:54:39 devstack cinder-volume[76789]: INFO cinder.volume.manager [None req-a5585d8f-2919-4b9f-b034-faf1a218bef6 None None] Driver post RPC initialization completed successfully. Sep 11 22:54:41 devstack cinder-volume[76629]: DEBUG dbcounter [-] [76629] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76629) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:54:45 devstack cinder-volume[76789]: DEBUG oslo_service.periodic_task [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running periodic task VolumeManager._thread_info {{(pid=76789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:54:45 devstack cinder-volume[76789]: DEBUG cinder.volume.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] thread count: 6 {{(pid=76789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:54:45 devstack cinder-volume[76789]: DEBUG cinder.volume.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] thread info: [<_MainThread(MainThread, started 132431392800896)>, , , , , ] {{(pid=76789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:54:49 devstack cinder-volume[76789]: DEBUG dbcounter [-] [76789] Writing DB stats cinder:SELECT=4 {{(pid=76789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:54:49 devstack cinder-volume[76789]: DEBUG dbcounter [-] [76789] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:55:45 devstack cinder-volume[76789]: DEBUG oslo_service.periodic_task [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:55:45 devstack cinder-volume[76789]: DEBUG cinder.volume.drivers.lvm [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Updating volume stats {{(pid=76789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:55:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:55:45 devstack sudo[80129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:55:45 devstack sudo[80129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:55:45 devstack sudo[80129]: pam_unix(sudo:session): session closed for user root Sep 11 22:55:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:55:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:55:45 devstack sudo[80132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:55:45 devstack sudo[80132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:55:46 devstack sudo[80132]: pam_unix(sudo:session): session closed for user root Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:55:46 devstack sudo[80135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:55:46 devstack sudo[80135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:55:46 devstack sudo[80135]: pam_unix(sudo:session): session closed for user root Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:55:46 devstack sudo[80138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:55:46 devstack sudo[80138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:55:46 devstack sudo[80138]: pam_unix(sudo:session): session closed for user root Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG cinder.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Notifying Schedulers of capabilities ... {{(pid=76789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG oslo_service.periodic_task [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running periodic task VolumeManager._thread_info {{(pid=76789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG cinder.volume.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] thread count: 6 {{(pid=76789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:55:46 devstack cinder-volume[76789]: DEBUG cinder.volume.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] thread info: [<_MainThread(MainThread, started 132431392800896)>, , , , , ] {{(pid=76789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:56:45 devstack cinder-volume[76789]: DEBUG oslo_service.periodic_task [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:56:45 devstack cinder-volume[76789]: DEBUG cinder.volume.drivers.lvm [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Updating volume stats {{(pid=76789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:56:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:56:45 devstack sudo[83498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:56:45 devstack sudo[83498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:56:45 devstack sudo[83498]: pam_unix(sudo:session): session closed for user root Sep 11 22:56:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:56:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:56:45 devstack sudo[83502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:56:45 devstack sudo[83502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:56:46 devstack sudo[83502]: pam_unix(sudo:session): session closed for user root Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:56:46 devstack sudo[83505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:56:46 devstack sudo[83505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:56:46 devstack sudo[83505]: pam_unix(sudo:session): session closed for user root Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:56:46 devstack sudo[83512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:56:46 devstack sudo[83512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:56:46 devstack sudo[83512]: pam_unix(sudo:session): session closed for user root Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG cinder.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Notifying Schedulers of capabilities ... {{(pid=76789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG oslo_service.periodic_task [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running periodic task VolumeManager._thread_info {{(pid=76789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG cinder.volume.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] thread count: 6 {{(pid=76789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:56:46 devstack cinder-volume[76789]: DEBUG cinder.volume.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] thread info: [<_MainThread(MainThread, started 132431392800896)>, , , , , ] {{(pid=76789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:56:49 devstack cinder-volume[76789]: DEBUG dbcounter [-] [76789] Writing DB stats cinder:SELECT=1 {{(pid=76789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:56:49 devstack cinder-volume[76789]: DEBUG dbcounter [-] [76789] Writing DB stats cinder:UPDATE=1 {{(pid=76789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:57:45 devstack cinder-volume[76789]: DEBUG oslo_service.periodic_task [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:57:45 devstack cinder-volume[76789]: DEBUG cinder.volume.drivers.lvm [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Updating volume stats {{(pid=76789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:57:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:57:45 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:57:45 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:57:45 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Sep 11 22:57:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:57:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:57:45 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:57:45 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:57:46 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:57:46 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:57:46 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:57:46 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:57:46 devstack sudo[85618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:57:46 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:57:46 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG cinder.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Notifying Schedulers of capabilities ... {{(pid=76789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG oslo_service.periodic_task [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running periodic task VolumeManager._thread_info {{(pid=76789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG cinder.volume.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] thread count: 6 {{(pid=76789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 22:57:46 devstack cinder-volume[76789]: DEBUG cinder.volume.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] thread info: [<_MainThread(MainThread, started 132431392800896)>, , , , , ] {{(pid=76789) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 22:58:45 devstack cinder-volume[76789]: DEBUG oslo_service.periodic_task [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76789) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 22:58:45 devstack cinder-volume[76789]: DEBUG cinder.volume.drivers.lvm [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Updating volume stats {{(pid=76789) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 11 22:58:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:45 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 11 22:58:45 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:45 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:45 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:45 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:58:45 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:46 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:46 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 11 22:58:46 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:46 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:58:46 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 11 22:58:46 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:58:46 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Sep 11 22:58:46 devstack cinder-volume[76789]: DEBUG oslo_concurrency.processutils [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76789) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:58:46 devstack cinder-volume[76789]: DEBUG cinder.manager [None req-7080568e-19ad-4e04-890d-84e6e8c372f7 None None] Notifying Schedulers of capabilities ... {{(pid=76789) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:58:49 devstack cinder-volume[76789]: DEBUG dbcounter [-] [76789] Writing DB stats cinder:SELECT=1 {{(pid=76789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:49 devstack cinder-volume[76789]: DEBUG dbcounter [-] [76789] Writing DB stats cinder:UPDATE=1 {{(pid=76789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:58:55 devstack cinder-volume[76629]: INFO oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Caught SIGTERM, stopping children Sep 11 22:58:55 devstack cinder-volume[76629]: DEBUG oslo_concurrency.lockutils [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Acquiring lock "singleton_lock" {{(pid=76629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:58:55 devstack cinder-volume[76629]: DEBUG oslo_concurrency.lockutils [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Acquired lock "singleton_lock" {{(pid=76629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:58:55 devstack cinder-volume[76629]: DEBUG oslo_concurrency.lockutils [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Releasing lock "singleton_lock" {{(pid=76629) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:58:55 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Stop services. {{(pid=76629) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 11 22:58:55 devstack cinder-volume[76629]: DEBUG oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Killing children. {{(pid=76629) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 11 22:58:55 devstack cinder-volume[76629]: INFO oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Waiting on 1 children to exit Sep 11 22:58:58 devstack cinder-volume[76789]: DEBUG oslo_concurrency.lockutils [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Acquiring lock "singleton_lock" {{(pid=76789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:58:58 devstack cinder-volume[76789]: DEBUG oslo_concurrency.lockutils [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Acquired lock "singleton_lock" {{(pid=76789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:58:58 devstack cinder-volume[76789]: DEBUG oslo_concurrency.lockutils [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Releasing lock "singleton_lock" {{(pid=76789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:58:58 devstack cinder-volume[76789]: WARNING amqp [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 22:58:58 devstack cinder-volume[76789]: WARNING amqp [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 22:58:58 devstack cinder-volume[76629]: INFO oslo_service.backend._eventlet.service [None req-73e478ab-e852-447a-8a16-4cb097d3dd92 None None] Child 76789 exited with status 0 Sep 11 22:58:58 devstack cinder-volume[87197]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 22:58:58 devstack cinder-volume[87197]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 22:58:58 devstack cinder-volume[87197]: we strongly recommend against using it for new projects. Sep 11 22:58:58 devstack cinder-volume[87197]: If you are already using Eventlet, we recommend migrating to a different Sep 11 22:58:58 devstack cinder-volume[87197]: framework. For more detail see Sep 11 22:58:58 devstack cinder-volume[87197]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 22:58:58 devstack cinder-volume[87197]: import eventlet # noqa Sep 11 22:59:00 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:59:00 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:59:00 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:59:01 devstack cinder-volume[87197]: INFO dbcounter [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Registered counter for database cinder Sep 11 22:59:01 devstack cinder-volume[87197]: DEBUG oslo_db.sqlalchemy.engines [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:59:01 devstack cinder-volume[87197]: DEBUG dbcounter [-] [87197] Writer thread running {{(pid=87197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:59:01 devstack cinder-volume[87197]: INFO cinder.rpc [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 22:59:01 devstack cinder-volume[87197]: INFO cinder.rpc [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 22:59:01 devstack cinder-volume[87197]: DEBUG oslo_db.sqlalchemy.engines [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:59:01 devstack cinder-volume[87197]: INFO cinder.volume.manager [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Determined volume DB was empty at startup. Sep 11 22:59:01 devstack cinder-volume[87197]: DEBUG cinder.volume.manager [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87197) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 22:59:01 devstack cinder-volume[87197]: INFO cinder.volume.manager [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 11 22:59:01 devstack cinder-volume[87197]: WARNING stevedore.named [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 22:59:01 devstack cinder-volume[87197]: WARNING castellan.key_manager [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:59:01 devstack cinder-volume[87197]: WARNING cinder.keymgr.conf_key_mgr [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:59:02 devstack cinder-volume[87197]: INFO cinder.volume.manager [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_db.sqlalchemy.engines [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:59:02 devstack cinder-volume[87197]: INFO oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Starting 1 workers Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Started child 87387 {{(pid=87197) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Full set of CONF: {{(pid=87197) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] ******************************************************************************** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Configuration options gathered from: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] ================================================================================ {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] allow_availability_zone_fallback = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] allow_compression_on_image_upload = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] allowed_direct_url_schemes = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] api_rate_limit = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] auth_strategy = keystone {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_availability_zone = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_host = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_stats_polling_interval = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backup_api_class = cinder.backup.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backup_name_template = backup-%s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backup_use_same_host = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87387]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backup_use_temp_snapshot = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] chap_password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] chap_username = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_internal_tenant_project_id = 4509e7bb950947699fe2fb77889e9622 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_internal_tenant_user_id = b5a17997241c4674b102b53447480d39 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cluster = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] compression_format = gzip {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] compute_api_class = cinder.compute.nova.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] config_dir = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] config_source = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] control_exchange = openstack {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] debug = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] default_availability_zone = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] default_group_type = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] default_volume_type = QuobyteHD {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] disk_geometry = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] driver_client_cert = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] driver_client_cert_key = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] driver_data_namespace = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] driver_ssl_cert_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] driver_ssl_cert_verify = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] driver_use_ssl = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] enable_new_services = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] enable_unsupported_driver = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] enabled_backends = ['QuobyteHD'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] enforce_multipath_for_image_xfer = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] filter_function = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_api_insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_api_ssl_compression = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_ca_certificates_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_catalog_info = image:glance:publicURL {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_num_retries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance_request_timeout = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] goodness_function = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] graceful_shutdown_timeout = 5 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] group_api_class = cinder.group.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] host = devstack {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_compress_on_upload = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_conversion_address_space_limit = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_conversion_cpu_limit = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_conversion_disable = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_introspection_address_space_limit = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_introspection_cpu_limit = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_upload_use_cinder_backend = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_upload_use_internal_tenant = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_volume_cache_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_volume_cache_max_count = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] image_volume_cache_max_size_gb = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] init_host_max_objects_retrieval = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] instance_format = [instance: %(uuid)s] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] iscsi_target_flags = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] iscsi_write_cache = on {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] iser_helper = tgtadm {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] iser_ip_address = 192.168.122.110 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] iser_port = 3260 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_color = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_config_append = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_dir = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_options = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_rotate_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_rotate_interval_type = days {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] log_rotation_type = none {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] max_age = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] max_logfile_count = 30 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] max_logfile_size_mb = 200 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] max_over_subscription_ratio = 20.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] message_reap_interval = 86400 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] message_ttl = 2592000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] migration_create_volume_timeout_secs = 300 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] monkey_patch = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] monkey_patch_modules = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] my_ip = 192.168.122.110 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] no_snapshot_gb_quota = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] num_iser_scan_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] num_shell_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] num_volume_device_scan_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] nvmeof_conn_info_version = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] nvmet_ns_id = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] nvmet_port_id = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] osapi_max_limit = 1000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] osapi_volume_ext_list = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] osapi_volume_listen_port = 8776 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] osapi_volume_use_ssl = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] osapi_volume_workers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] per_volume_size_limit = -1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] periodic_fuzzy_delay = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] periodic_interval = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] public_endpoint = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] publish_errors = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] quota_backup_gigabytes = 1000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] quota_backups = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] quota_gigabytes = 1000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] quota_groups = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] quota_snapshots = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] quota_volumes = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] rate_limit_burst = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] rate_limit_except_level = CRITICAL {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] rate_limit_interval = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] reinit_driver_count = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] replication_device = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] report_discard_supported = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] report_interval = 120 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] reservation_clean_interval = 86400 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] reservation_expire = 86400 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] reserved_image_namespaces = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] reserved_percentage = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] rpc_response_timeout = 120 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] run_external_periodic_tasks = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] scst_target_driver = iscsi {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] scst_target_iqn_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_down_time = 720 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] shell_completion = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] snapshot_name_template = snapshot-%s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87387]: INFO cinder.volume.manager [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.remotefs [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87387) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] split_loggers = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] state_path = /opt/stack/data/cinder {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] storage_availability_zone = nova {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] storage_protocol = iSCSI {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] syslog_log_facility = LOG_USER {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] target_helper = lioadm {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] target_ip_address = 192.168.122.110 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] target_port = 3260 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] target_protocol = iscsi {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] target_secondary_ip_addresses = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] trace_flags = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] transport_url = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] until_refresh = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] use_chap_auth = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] use_default_quota_class = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] use_journal = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] use_json = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] use_multipath_for_image_xfer = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] use_stderr = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] use_syslog = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] verify_glance_signatures = enabled {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_api_class = cinder.volume.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_backend_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_clear = zero {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_clear_ionice = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_clear_size = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_copy_bps_limit = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_dd_blocksize = 1M {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_name_template = volume-%s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_service_inithost_offload = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volume_usage_audit_period = month {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] zoning_mode = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_concurrency.disable_process_locking = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.auth_section = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.auth_type = password {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.auth_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.cache = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.include_service_catalog = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.interface = public {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcache_username = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.region_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.service_type = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.backend = dogpile.cache.null {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.backend_argument = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.backend_expiration_time = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.config_prefix = cache.oslo {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.debug_cache_backend = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.enable_retry_client = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.enable_socket_keepalive = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.expiration_time = 600 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.hashclient_retry_attempts = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.memcache_dead_retry = 300 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.memcache_pool_maxsize = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.memcache_sasl_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.proxies = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.redis_db = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.redis_server = localhost:6379 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.retry_attempts = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.retry_delay = 0.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.socket_keepalive_count = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.socket_keepalive_idle = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.socket_keepalive_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.socket_timeout = 1.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.tls_allowed_ciphers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.tls_cafile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.tls_certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.tls_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.tls_keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cache.username = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] coordination.backend_url = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.asyncio_connection = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.asyncio_slave_connection = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.backend = sqlalchemy {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.connection = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.connection_debug = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.connection_parameters = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.connection_recycle_time = 3600 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.connection_trace = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.db_inc_retry_interval = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.db_max_retries = 20 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.db_max_retry_interval = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.db_retry_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.max_overflow = 50 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.max_pool_size = 5 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.max_retries = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.mysql_wsrep_sync_wait = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.pool_timeout = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.retry_interval = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.slave_connection = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.sqlite_synchronous = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.synchronous_reader = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] database.use_db_reconnect = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_tracing.insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.connection_string = messaging:// {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.es_doc_type = notification {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.es_scroll_size = 10000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.es_scroll_time = 2m {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.filter_error_trace = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.hmac_keys = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.sentinel_service_name = mymaster {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.socket_timeout = 0.1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.trace_requests = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler.trace_sqlalchemy = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler_jaeger.process_tags = {} {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler_jaeger.service_name_prefix = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] profiler_otlp.service_name_prefix = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.enforce_new_defaults = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.policy_default_rule = default {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.policy_file = policy.yaml {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] privsep_osbrick.group = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] privsep_osbrick.helper_command = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] privsep_osbrick.user = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_sys_admin.group = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_sys_admin.helper_command = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] cinder_sys_admin.user = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.auth_section = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.auth_type = password {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.cafile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.collect_timing = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.send_service_user_token = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.split_loggers = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.timeout = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.tls_ciphers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] service_user.tls_min_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.auth_section = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.auth_type = password {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.collect_timing = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.region_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.split_loggers = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.timeout = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.tls_ciphers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] glance.tls_min_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.backend_availability_zone = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.chap_password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.chap_username = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.disk_geometry = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.driver_client_cert = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.driver_client_cert_key = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.driver_data_namespace = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.driver_use_ssl = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.extra_capabilities = {} {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.filter_function = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.goodness_function = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.iscsi_target_flags = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.iscsi_write_cache = on {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.iser_helper = tgtadm {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.iser_port = 3260 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_host = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_login = admin {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_mount_options = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_private_key = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_share_path = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.num_shell_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.quobyte_volume_url = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.replication_device = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.report_discard_supported = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.reserved_percentage = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.target_helper = tgtadm {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.target_port = 3260 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.target_protocol = iscsi {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.trace_flags = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.unique_fqdn_network = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.use_chap_auth = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volume_backend_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volume_clear = zero {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volume_clear_ionice = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volume_clear_size = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87387) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87387]: WARNING cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 11 22:59:02 devstack cinder-volume[87387]: WARNING cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_reports.file_event_handler = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_reports.log_dir = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.backend_availability_zone = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.backend_host = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.chap_password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.chap_username = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.chiscsi_conf = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.disk_geometry = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.driver_client_cert = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Running cmd (subprocess): mount.quobyte {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.driver_data_namespace = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.driver_use_ssl = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.extra_capabilities = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.filter_function = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.goodness_function = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.iser_helper = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.iser_ip_address = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.iser_port = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.iser_target_prefix = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_host = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_login = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_mount_options = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_private_key = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_share_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_ssh_port = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.num_shell_tries = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.nvmet_port_id = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.replication_device = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.report_discard_supported = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.reserved_percentage = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.scst_target_driver = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.storage_protocol = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.target_helper = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.target_ip_address = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.target_port = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.target_prefix = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.target_protocol = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.trace_flags = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.use_chap_auth = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volume_clear = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volume_clear_size = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] QuobyteHD.volumes_dir = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.ssl = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_notifications.driver = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_notifications.retry = -1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] key_manager.fixed_key = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.barbican_api_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.barbican_endpoint = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.barbican_endpoint_type = public {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.barbican_region_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.cafile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.collect_timing = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.number_of_retries = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.retry_delay = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.send_service_user_token = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.split_loggers = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.timeout = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.tls_ciphers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.tls_min_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.verify_ssl = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican.verify_ssl_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.auth_section = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.auth_type = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.cafile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.collect_timing = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.split_loggers = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.timeout = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.tls_ciphers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] barbican_service_user.tls_min_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.approle_role_id = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.approle_secret_id = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.auth_method = approle {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.auth_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.kv_mountpoint = secret {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.kv_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.kv_version = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.namespace = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.root_token_id = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.ssl_ca_crt_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.timeout = 60.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.token_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.token_role = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.use_ssl = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:02 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] ******************************************************************************** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] CMD "mount.quobyte" returned: 1 in 0.127s {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=87387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:02 devstack cinder-volume[87387]: INFO cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 ... Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 -c /etc/quobyte/client-cinder.cfg {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:02 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 -c /etc/quobyte/client-cinder.cfg Sep 11 22:59:02 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:02 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.432s {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:02 devstack cinder-volume[87387]: INFO cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 succeeded Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=87387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.447s {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:02 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:02 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 22:59:02 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:03 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.251s {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:03 devstack cinder-volume[87387]: INFO cinder.volume.driver [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Driver hasn't implemented _init_vendor_properties() Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.volume.driver [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87387) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_db.sqlalchemy.engines [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87387) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG dbcounter [-] [87387] Writer thread running {{(pid=87387) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.db.api [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Building query based on filter {{(pid=87387) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.image.image_utils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87387) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 22:59:03 devstack cinder-volume[87387]: INFO cinder.keymgr.migration [None req-f06fe448-cfb7-46a1-a5b5-4e83a4f7e673 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=87387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=87387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:03 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 22:59:03 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:03 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.255s {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.manager [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Notifying Schedulers of capabilities ... {{(pid=87387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:59:03 devstack cinder-volume[87387]: INFO cinder.volume.manager [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Driver initialization completed successfully. Sep 11 22:59:03 devstack cinder-volume[87387]: INFO cinder.manager [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Initiating service 3 cleanup Sep 11 22:59:03 devstack cinder-volume[87387]: INFO cinder.manager [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Service 3 cleanup completed. Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.service [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Creating RPC server for service cinder-volume {{(pid=87387) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.service [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87387) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 22:59:03 devstack cinder-volume[87387]: INFO cinder.volume.manager [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=87387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=87387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:03 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:03 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 22:59:03 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:04 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:04 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.239s {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:04 devstack cinder-volume[87387]: INFO cinder.volume.manager [None req-a0bf3594-f220-4d4a-ad5c-3274268a77d1 None None] Driver post RPC initialization completed successfully. Sep 11 22:59:08 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:08 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:08 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=87387) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:08 devstack cinder-volume[87387]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=87387) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:08 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87387) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:08 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:08 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 22:59:08 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:08 devstack cinder-volume[87197]: INFO oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Caught SIGTERM, stopping children Sep 11 22:59:08 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Acquiring lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:59:08 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Acquired lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:59:08 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Releasing lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:59:08 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Stop services. {{(pid=87197) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 11 22:59:08 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Killing children. {{(pid=87197) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 11 22:59:08 devstack cinder-volume[87197]: INFO oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Waiting on 1 children to exit Sep 11 22:59:09 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:09 devstack cinder-volume[87387]: DEBUG oslo_concurrency.processutils [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.418s {{(pid=87387) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:09 devstack cinder-volume[87387]: DEBUG cinder.manager [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Notifying Schedulers of capabilities ... {{(pid=87387) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Unable to connect to AMQP server on 192.168.122.110:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server [None req-5ad0f8fb-704b-46c2-be15-0db7d535f3f3 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.110:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server method() Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return _publish( Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server listener(*args) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.110:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 11 22:59:09 devstack cinder-volume[87387]: ERROR oslo_messaging.rpc.server Sep 11 22:59:12 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Acquiring lock "singleton_lock" {{(pid=87387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:59:12 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Acquired lock "singleton_lock" {{(pid=87387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:59:12 devstack cinder-volume[87387]: DEBUG oslo_concurrency.lockutils [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Releasing lock "singleton_lock" {{(pid=87387) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:59:12 devstack cinder-volume[87387]: WARNING amqp [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 22:59:12 devstack cinder-volume[87387]: WARNING amqp [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 11 22:59:12 devstack cinder-volume[87197]: INFO oslo_service.backend._eventlet.service [None req-f3993d33-d98f-4c53-951c-db032c82db00 None None] Child 87387 exited with status 0 Sep 11 22:59:12 devstack cinder-volume[87730]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 11 22:59:12 devstack cinder-volume[87730]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 22:59:12 devstack cinder-volume[87730]: we strongly recommend against using it for new projects. Sep 11 22:59:12 devstack cinder-volume[87730]: If you are already using Eventlet, we recommend migrating to a different Sep 11 22:59:12 devstack cinder-volume[87730]: framework. For more detail see Sep 11 22:59:12 devstack cinder-volume[87730]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 22:59:12 devstack cinder-volume[87730]: import eventlet # noqa Sep 11 22:59:15 devstack cinder-volume[87730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 11 22:59:15 devstack cinder-volume[87730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 11 22:59:15 devstack cinder-volume[87730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 11 22:59:16 devstack cinder-volume[87730]: INFO dbcounter [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Registered counter for database cinder Sep 11 22:59:16 devstack cinder-volume[87730]: DEBUG oslo_db.sqlalchemy.engines [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:59:16 devstack cinder-volume[87730]: DEBUG dbcounter [-] [87730] Writer thread running {{(pid=87730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:59:16 devstack cinder-volume[87730]: INFO cinder.rpc [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 11 22:59:16 devstack cinder-volume[87730]: INFO cinder.rpc [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 11 22:59:16 devstack cinder-volume[87730]: DEBUG oslo_db.sqlalchemy.engines [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:59:17 devstack cinder-volume[87730]: INFO cinder.volume.manager [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Determined volume DB was empty at startup. Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG cinder.volume.manager [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87730) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 11 22:59:17 devstack cinder-volume[87730]: WARNING stevedore.named [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 11 22:59:17 devstack cinder-volume[87730]: WARNING castellan.key_manager [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:59:17 devstack cinder-volume[87730]: WARNING cinder.keymgr.conf_key_mgr [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 11 22:59:17 devstack cinder-volume[87730]: INFO cinder.volume.manager [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_db.sqlalchemy.engines [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:59:17 devstack cinder-volume[87730]: INFO oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Starting 1 workers Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Started child 88026 {{(pid=87730) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Full set of CONF: {{(pid=87730) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] ******************************************************************************** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] Configuration options gathered from: {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 11 22:59:17 devstack cinder-volume[88026]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] ================================================================================ {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] allow_availability_zone_fallback = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] allow_compression_on_image_upload = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] allowed_direct_url_schemes = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] api_rate_limit = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] auth_strategy = keystone {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_availability_zone = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_host = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_stats_polling_interval = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backup_api_class = cinder.backup.api.API {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backup_name_template = backup-%s {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backup_use_same_host = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backup_use_temp_snapshot = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] chap_password = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] chap_username = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_internal_tenant_project_id = 4509e7bb950947699fe2fb77889e9622 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_internal_tenant_user_id = b5a17997241c4674b102b53447480d39 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cluster = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] compression_format = gzip {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] compute_api_class = cinder.compute.nova.API {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] config_dir = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] config_source = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] control_exchange = openstack {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] debug = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] default_availability_zone = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] default_group_type = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] default_volume_type = QuobyteHD {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] disk_geometry = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] driver_client_cert = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] driver_client_cert_key = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] driver_data_namespace = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] driver_ssl_cert_path = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] driver_ssl_cert_verify = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] driver_use_ssl = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] enable_new_services = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] enable_unsupported_driver = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] enabled_backends = ['QuobyteHD'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] enforce_multipath_for_image_xfer = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] filter_function = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_api_insecure = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_api_ssl_compression = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_ca_certificates_file = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_catalog_info = image:glance:publicURL {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_certfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_keyfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_num_retries = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance_request_timeout = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] goodness_function = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] graceful_shutdown_timeout = 5 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] group_api_class = cinder.group.api.API {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] host = devstack {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_compress_on_upload = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_conversion_address_space_limit = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_conversion_cpu_limit = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_conversion_disable = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_introspection_address_space_limit = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_introspection_cpu_limit = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_upload_use_cinder_backend = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_upload_use_internal_tenant = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_volume_cache_enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_volume_cache_max_count = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] image_volume_cache_max_size_gb = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] init_host_max_objects_retrieval = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] instance_format = [instance: %(uuid)s] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Starting volume driver QuobyteDriver (1.2.1) Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88026) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] iscsi_target_flags = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] iscsi_write_cache = on {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] iser_helper = tgtadm {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] iser_ip_address = 192.168.122.110 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] iser_port = 3260 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_color = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_config_append = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_dir = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_file = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_options = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_rotate_interval = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_rotate_interval_type = days {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] log_rotation_type = none {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] max_age = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] max_logfile_count = 30 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] max_logfile_size_mb = 200 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] max_over_subscription_ratio = 20.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] message_reap_interval = 86400 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] message_ttl = 2592000 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] migration_create_volume_timeout_secs = 300 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] monkey_patch = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] monkey_patch_modules = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] my_ip = 192.168.122.110 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] no_snapshot_gb_quota = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] num_iser_scan_tries = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] num_shell_tries = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] num_volume_device_scan_tries = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] nvmeof_conn_info_version = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] nvmet_ns_id = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] nvmet_port_id = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] osapi_max_limit = 1000 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] osapi_volume_ext_list = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] osapi_volume_listen_port = 8776 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] osapi_volume_use_ssl = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] osapi_volume_workers = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] per_volume_size_limit = -1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] periodic_fuzzy_delay = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] periodic_interval = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] public_endpoint = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] publish_errors = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] quota_backup_gigabytes = 1000 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] quota_backups = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] quota_gigabytes = 1000 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] quota_groups = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] quota_snapshots = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] quota_volumes = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] rate_limit_burst = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] rate_limit_except_level = CRITICAL {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] rate_limit_interval = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] reinit_driver_count = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] replication_device = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] report_discard_supported = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] report_interval = 120 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] reservation_clean_interval = 86400 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] reservation_expire = 86400 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] reserved_image_namespaces = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] reserved_percentage = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] rpc_response_timeout = 120 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] run_external_periodic_tasks = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] scst_target_driver = iscsi {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] scst_target_iqn_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_down_time = 720 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] shell_completion = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] snapshot_name_template = snapshot-%s {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] split_loggers = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] state_path = /opt/stack/data/cinder {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] storage_availability_zone = nova {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] storage_protocol = iSCSI {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] syslog_log_facility = LOG_USER {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] target_helper = lioadm {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] target_ip_address = 192.168.122.110 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] target_port = 3260 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] target_protocol = iscsi {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] target_secondary_ip_addresses = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] trace_flags = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] transport_url = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] until_refresh = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] use_chap_auth = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] use_default_quota_class = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] use_journal = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] use_json = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] use_multipath_for_image_xfer = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] use_stderr = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] use_syslog = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] verify_glance_signatures = enabled {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_api_class = cinder.volume.api.API {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_backend_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_clear = zero {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_clear_ionice = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_clear_size = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_copy_bps_limit = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_dd_blocksize = 1M {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_name_template = volume-%s {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_service_inithost_offload = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volume_usage_audit_period = month {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] zoning_mode = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_concurrency.disable_process_locking = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.auth_section = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.auth_type = password {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.auth_version = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.cache = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.certfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.include_service_catalog = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.insecure = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.interface = public {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.keyfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_password = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcache_username = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.region_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.service_type = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.backend = dogpile.cache.null {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88026) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.backend_argument = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.backend_expiration_time = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.config_prefix = cache.oslo {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.debug_cache_backend = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.enable_retry_client = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.enable_socket_keepalive = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.expiration_time = 600 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.hashclient_retry_attempts = 2 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.memcache_dead_retry = 300 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.memcache_pool_maxsize = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.memcache_sasl_enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.password = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.proxies = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.redis_db = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.redis_server = localhost:6379 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.retry_attempts = 2 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Running cmd (subprocess): mount.quobyte {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.retry_delay = 0.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.socket_keepalive_count = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.socket_keepalive_idle = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.socket_keepalive_interval = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.socket_timeout = 1.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.tls_allowed_ciphers = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.tls_cafile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.tls_certfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.tls_enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.tls_keyfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cache.username = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] coordination.backend_url = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.asyncio_connection = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.asyncio_slave_connection = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.backend = sqlalchemy {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.connection = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.connection_debug = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.connection_parameters = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.connection_recycle_time = 3600 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.connection_trace = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.db_inc_retry_interval = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.db_max_retries = 20 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.db_max_retry_interval = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.db_retry_interval = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.max_overflow = 50 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.max_pool_size = 5 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.max_retries = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.mysql_wsrep_sync_wait = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.pool_timeout = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.retry_interval = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.slave_connection = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.sqlite_synchronous = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.synchronous_reader = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] database.use_db_reconnect = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_tracing.insecure = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.connection_string = messaging:// {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.es_doc_type = notification {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.es_scroll_size = 10000 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.es_scroll_time = 2m {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.filter_error_trace = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.hmac_keys = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.sentinel_service_name = mymaster {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.socket_timeout = 0.1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.trace_requests = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler.trace_sqlalchemy = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler_jaeger.process_tags = {} {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler_jaeger.service_name_prefix = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] profiler_otlp.service_name_prefix = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.enforce_new_defaults = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.policy_default_rule = default {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.policy_file = policy.yaml {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] privsep_osbrick.group = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] privsep_osbrick.helper_command = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] privsep_osbrick.user = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_sys_admin.group = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_sys_admin.helper_command = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] cinder_sys_admin.user = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.auth_section = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.auth_type = password {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.cafile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.certfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.collect_timing = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.insecure = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.keyfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.send_service_user_token = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.split_loggers = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.timeout = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.tls_ciphers = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] service_user.tls_min_version = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.auth_section = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.auth_type = password {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.certfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.collect_timing = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.insecure = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.keyfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.region_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.split_loggers = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.timeout = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.tls_ciphers = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] glance.tls_min_version = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.backend_availability_zone = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.chap_password = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.chap_username = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.disk_geometry = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.driver_client_cert = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.driver_client_cert_key = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.driver_data_namespace = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack quobyte-client[88027]: Reading configuration file: /etc/quobyte/client.cfg Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.driver_use_ssl = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.extra_capabilities = {} {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.filter_function = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.goodness_function = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack quobyte-client[88027]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.iscsi_target_flags = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.iscsi_write_cache = on {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.iser_helper = tgtadm {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.iser_port = 3260 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_host = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_login = admin {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_mount_options = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_password = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_private_key = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_share_path = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.num_shell_tries = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.quobyte_volume_url = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.replication_device = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.report_discard_supported = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.reserved_percentage = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.target_helper = tgtadm {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.target_port = 3260 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.target_protocol = iscsi {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.trace_flags = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.unique_fqdn_network = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.use_chap_auth = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volume_backend_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volume_clear = zero {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volume_clear_ionice = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volume_clear_size = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_reports.file_event_handler = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_reports.log_dir = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.backend_availability_zone = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.backend_host = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.chap_password = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.chap_username = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.chiscsi_conf = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.disk_geometry = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.driver_client_cert = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.driver_data_namespace = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.driver_use_ssl = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.extra_capabilities = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.filter_function = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.goodness_function = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.iser_helper = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.iser_ip_address = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.iser_port = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.iser_target_prefix = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_host = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_login = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_mount_options = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_password = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_private_key = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_share_path = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_ssh_port = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.num_shell_tries = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.nvmet_port_id = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.replication_device = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.report_discard_supported = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.reserved_percentage = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.scst_target_driver = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.storage_protocol = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.target_helper = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.target_ip_address = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.target_port = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.target_prefix = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.target_protocol = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.trace_flags = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.use_chap_auth = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volume_clear = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volume_clear_size = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] QuobyteHD.volumes_dir = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.ssl = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_notifications.driver = [] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_notifications.retry = -1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] key_manager.fixed_key = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.barbican_api_version = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.barbican_endpoint = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.barbican_endpoint_type = public {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.barbican_region_name = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.cafile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.certfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.collect_timing = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.insecure = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.keyfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.number_of_retries = 60 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.retry_delay = 1 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.send_service_user_token = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.split_loggers = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.timeout = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.tls_ciphers = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.tls_min_version = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.verify_ssl = True {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican.verify_ssl_path = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.auth_section = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.auth_type = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.cafile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.certfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.collect_timing = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.insecure = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.keyfile = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.split_loggers = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.timeout = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.tls_ciphers = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] barbican_service_user.tls_min_version = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.approle_role_id = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.approle_secret_id = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.auth_method = approle {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.auth_path = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.kv_mountpoint = secret {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.kv_path = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.kv_version = 2 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.namespace = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.root_token_id = **** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.ssl_ca_crt_file = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.timeout = 60.0 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.token_file = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.token_role = None {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.use_ssl = False {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 11 22:59:17 devstack cinder-volume[87730]: DEBUG oslo_service.backend._eventlet.service [None req-47f3aec1-f9f8-4e51-b314-83a599da9489 None None] ******************************************************************************** {{(pid=87730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 11 22:59:17 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:17 devstack cinder-volume[88026]: INFO cinder.volume.driver [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Driver hasn't implemented _init_vendor_properties() Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.volume.driver [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88026) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88026) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writer thread running {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.db.api [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Building query based on filter {{(pid=88026) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88026) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:17 devstack cinder-volume[88026]: INFO cinder.keymgr.migration [None req-32e23271-7932-4b31-b47c-595a5136d868 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 11 22:59:17 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 22:59:17 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:17 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.251s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:17 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 22:59:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Driver initialization completed successfully. Sep 11 22:59:18 devstack cinder-volume[88026]: INFO cinder.manager [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Initiating service 3 cleanup Sep 11 22:59:18 devstack cinder-volume[88026]: INFO cinder.manager [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Service 3 cleanup completed. Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG cinder.service [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Creating RPC server for service cinder-volume {{(pid=88026) start /opt/stack/cinder/cinder/service.py:231}} Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG cinder.service [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88026) start /opt/stack/cinder/cinder/service.py:237}} Sep 11 22:59:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 22:59:18 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 22:59:18 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 22:59:18 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Sep 11 22:59:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.247s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 22:59:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8eb00ffb-b8b9-4d60-a1a6-07829573ebed None None] Driver post RPC initialization completed successfully. Sep 11 22:59:27 devstack cinder-volume[87730]: DEBUG dbcounter [-] [87730] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:59:28 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 22:59:28 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=3 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:00:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:00:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 6 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:00:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Flow 'volume_create_manager' (37987bff-de14-4db7-80bb-01b03d115744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a007ccb4-330f-4527-87f1-2e032615a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a007ccb4-330f-4527-87f1-2e032615a190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-888312925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408debc5-4e42-43b3-a405-1f11d4a6d222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ababec67eac4d9bad8866119e0ce8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:00:16Z,use_quota=True,user_id='8331331aac1a45a09133426a06e49ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aac6e18-c05a-4419-89e2-3efa89cfbcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aac6e18-c05a-4419-89e2-3efa89cfbcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df78c4d-0b4c-4a75-aad0-e273d1a5a2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df78c4d-0b4c-4a75-aad0-e273d1a5a2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408debc5-4e42-43b3-a405-1f11d4a6d222', 'volume_name': 'volume-408debc5-4e42-43b3-a405-1f11d4a6d222', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130cb91b-841f-4a55-b232-29feb24f97cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130cb91b-841f-4a55-b232-29feb24f97cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a41d6f-e8de-4ce8-b12a-4c25437c7a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:16 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Volume 408debc5-4e42-43b3-a405-1f11d4a6d222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408debc5-4e42-43b3-a405-1f11d4a6d222', 'volume_size': 1} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-888312925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408debc5-4e42-43b3-a405-1f11d4a6d222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ababec67eac4d9bad8866119e0ce8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:00:16Z,use_quota=True,user_id='8331331aac1a45a09133426a06e49ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Creating volume 408debc5-4e42-43b3-a405-1f11d4a6d222 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:00:16 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:00:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:16 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 1073741824 Sep 11 23:00:16 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:17 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 1073741824" returned: 0 in 0.582s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:17 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 Sep 11 23:00:17 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:17 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222" returned: 0 in 0.277s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a41d6f-e8de-4ce8-b12a-4c25437c7a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408debc5-4e42-43b3-a405-1f11d4a6d222', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8f7570-f34c-4ebb-88ab-24af38875698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:17 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Volume volume-408debc5-4e42-43b3-a405-1f11d4a6d222 (408debc5-4e42-43b3-a405-1f11d4a6d222): created successfully Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8f7570-f34c-4ebb-88ab-24af38875698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Flow 'volume_create_manager' (37987bff-de14-4db7-80bb-01b03d115744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:00:17 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-048270f7-7b8c-433b-80f8-5e9bf8b43723 tempest-TaggedAttachmentsTest-1423741794 None] Created volume successfully. Sep 11 23:00:27 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:00:27 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Flow 'volume_create_manager' (80315377-38bc-42eb-a6cb-acde16fa66dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89364f1b-a12c-4cb8-8fb4-b7fc7a255a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89364f1b-a12c-4cb8-8fb4-b7fc7a255a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-745792699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fece70a3-b1ae-4ff9-8550-e7f8bf276512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5e4370be984545a7fc3009ca28a052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:00:32Z,use_quota=True,user_id='2df64a521b1644b78b721de573ad23b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721608a9-5892-4f85-ba98-61541cd25dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721608a9-5892-4f85-ba98-61541cd25dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2681acc-223c-4ffa-b476-06574fcb7e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2681acc-223c-4ffa-b476-06574fcb7e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fece70a3-b1ae-4ff9-8550-e7f8bf276512', 'volume_name': 'volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60e1aab-a78b-464a-bec5-a179d42b07f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60e1aab-a78b-464a-bec5-a179d42b07f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b29d15-745f-4a88-bb5c-bac3f629b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:31 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Volume fece70a3-b1ae-4ff9-8550-e7f8bf276512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512', 'volume_size': 1} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-745792699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fece70a3-b1ae-4ff9-8550-e7f8bf276512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5e4370be984545a7fc3009ca28a052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:00:32Z,use_quota=True,user_id='2df64a521b1644b78b721de573ad23b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Creating volume fece70a3-b1ae-4ff9-8550-e7f8bf276512 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:00:31 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:00:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:31 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 1073741824 Sep 11 23:00:31 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:33 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 1073741824" returned: 0 in 1.174s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:33 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 Sep 11 23:00:33 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:33 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512" returned: 0 in 0.538s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b29d15-745f-4a88-bb5c-bac3f629b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c71bd9-79a5-4e00-a23b-c40ceb9f264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:33 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Volume volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 (fece70a3-b1ae-4ff9-8550-e7f8bf276512): created successfully Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c71bd9-79a5-4e00-a23b-c40ceb9f264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Flow 'volume_create_manager' (80315377-38bc-42eb-a6cb-acde16fa66dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:00:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d5c1de22-9511-4d53-b430-3ac31ebc05d7 tempest-DeleteServersTestJSON-94626041 None] Created volume successfully. Sep 11 23:00:38 devstack cinder-volume[88026]: WARNING py.warnings [req-94bb49bf-8991-47ad-bb6a-67ec4f589e25 req-e15b41b8-0b9d-45f9-b368-58c0145928d9 tempest-DeleteServersTestJSON-94626041 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 11 23:00:38 devstack cinder-volume[88026]: .first() Sep 11 23:00:38 devstack cinder-volume[88026]: Sep 11 23:00:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-94bb49bf-8991-47ad-bb6a-67ec4f589e25 req-e15b41b8-0b9d-45f9-b368-58c0145928d9 tempest-DeleteServersTestJSON-94626041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-94bb49bf-8991-47ad-bb6a-67ec4f589e25 req-e15b41b8-0b9d-45f9-b368-58c0145928d9 tempest-DeleteServersTestJSON-94626041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-94bb49bf-8991-47ad-bb6a-67ec4f589e25 req-e15b41b8-0b9d-45f9-b368-58c0145928d9 tempest-DeleteServersTestJSON-94626041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-94bb49bf-8991-47ad-bb6a-67ec4f589e25 req-e15b41b8-0b9d-45f9-b368-58c0145928d9 tempest-DeleteServersTestJSON-94626041 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06e67c03-d2df-4839-b492-238d00ba0c63', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:00:38 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-94bb49bf-8991-47ad-bb6a-67ec4f589e25 req-e15b41b8-0b9d-45f9-b368-58c0145928d9 tempest-DeleteServersTestJSON-94626041 None] attachment_update completed successfully. Sep 11 23:00:46 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-41165f7e-2199-4df7-b265-2e60e410f43a req-f6b282fb-7e08-4629-a97a-f45e31ac238c tempest-DeleteServersTestJSON-94626041 None] Terminate volume connection completed successfully. Sep 11 23:00:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-41165f7e-2199-4df7-b265-2e60e410f43a req-f6b282fb-7e08-4629-a97a-f45e31ac238c tempest-DeleteServersTestJSON-94626041 None] Deleting attachment 06e67c03-d2df-4839-b492-238d00ba0c63. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:00:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Acquiring lock "cinder-fece70a3-b1ae-4ff9-8550-e7f8bf276512-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:00:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Lock "cinder-fece70a3-b1ae-4ff9-8550-e7f8bf276512-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Acquiring lock "cinder-quobyte-fece70a3-b1ae-4ff9-8550-e7f8bf276512" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Lock "cinder-quobyte-fece70a3-b1ae-4ff9-8550-e7f8bf276512" acquired by "delete_volume" :: waited 0.071s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:00:49 devstack cinder-volume[88026]: INFO oslo.privsep.daemon [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpeawh900p/privsep.sock'] Sep 11 23:00:49 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpeawh900p/privsep.sock Sep 11 23:00:49 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Flow 'volume_create_manager' (8d663b50-b4a3-4b45-bbb3-403726d9bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d526104f-0df3-4f50-a378-105dd9cef5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d526104f-0df3-4f50-a378-105dd9cef5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1778611898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8500ba42-25af-434b-a8d7-e2c528d8def8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175efe51935a4b769844debb42655e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:00:49Z,use_quota=True,user_id='ad5b7ecb7bc64e21afca6b6b171d4f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2976097-f8ce-424b-a34d-0120b17c4c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2976097-f8ce-424b-a34d-0120b17c4c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7becc12f-9661-49d2-bc57-bb2a49c4d980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7becc12f-9661-49d2-bc57-bb2a49c4d980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8500ba42-25af-434b-a8d7-e2c528d8def8', 'volume_name': 'volume-8500ba42-25af-434b-a8d7-e2c528d8def8', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0635667-095d-4100-b820-9386e8f784f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0635667-095d-4100-b820-9386e8f784f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3beb49-476b-4a0d-822d-030fddc8a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Volume 8500ba42-25af-434b-a8d7-e2c528d8def8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8500ba42-25af-434b-a8d7-e2c528d8def8', 'volume_size': 1} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1778611898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8500ba42-25af-434b-a8d7-e2c528d8def8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175efe51935a4b769844debb42655e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:00:49Z,use_quota=True,user_id='ad5b7ecb7bc64e21afca6b6b171d4f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Creating volume 8500ba42-25af-434b-a8d7-e2c528d8def8 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:00:49 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:00:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:49 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 1073741824 Sep 11 23:00:49 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:50 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 1073741824" returned: 0 in 1.387s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:51 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 Sep 11 23:00:51 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: Sep 11 23:00:51 devstack cinder-volume[88026]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 11 23:00:51 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8" returned: 0 in 0.487s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3beb49-476b-4a0d-822d-030fddc8a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8500ba42-25af-434b-a8d7-e2c528d8def8', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88431bcb-ef08-45f0-a463-818a59d67310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:00:51 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Volume volume-8500ba42-25af-434b-a8d7-e2c528d8def8 (8500ba42-25af-434b-a8d7-e2c528d8def8): created successfully Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88431bcb-ef08-45f0-a463-818a59d67310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Flow 'volume_create_manager' (8d663b50-b4a3-4b45-bbb3-403726d9bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:00:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a78cd062-d466-433e-8daf-a6e8bb7b398d tempest-VolumesAdminNegativeTest-23486467 None] Created volume successfully. Sep 11 23:00:51 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:51 devstack cinder-volume[88026]: INFO oslo.privsep.daemon [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Spawned new privsep daemon via rootwrap Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Accepted privsep connection to /tmp/tmpeawh900p/privsep.sock {{(pid=88026) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 11 23:00:51 devstack cinder-volume[88026]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 11 23:00:51 devstack cinder-volume[88026]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 11 23:00:51 devstack cinder-volume[88026]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 11 23:00:51 devstack cinder-volume[88026]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89669 Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03c5ecf-568e-40a6-ac91-6b77c2e2f0fc]: (2,) {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8d905a-6794-4df3-a65f-8af0f700f7b9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:00:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:51 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 Sep 11 23:00:51 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:52 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512" returned: 0 in 0.917s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:52 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512 Sep 11 23:00:52 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:53 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fece70a3-b1ae-4ff9-8550-e7f8bf276512" returned: 0 in 0.679s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Lock "cinder-quobyte-fece70a3-b1ae-4ff9-8550-e7f8bf276512" released by "delete_volume" :: held 4.108s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:00:53 devstack cinder-volume[88026]: WARNING cinder.quota [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:00:53 devstack cinder-volume[88026]: WARNING cinder.quota [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Created reservations ['54f7d7d7-9f3e-44a6-b9ed-101fd0be05c9', 'aceb22c2-0112-4fce-94bd-5226e549e9bf', 'e8a4a3b8-8408-4dcf-b072-42fd7eabb806', '10452ada-6150-47bd-a428-d8e4ee92efea'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Acquiring lock "cinder-8500ba42-25af-434b-a8d7-e2c528d8def8-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Lock "cinder-8500ba42-25af-434b-a8d7-e2c528d8def8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:00:53 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:00:53 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Acquiring lock "cinder-quobyte-8500ba42-25af-434b-a8d7-e2c528d8def8" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:00:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Lock "cinder-quobyte-8500ba42-25af-434b-a8d7-e2c528d8def8" acquired by "delete_volume" :: waited 0.046s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:00:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01fe8bb-9410-4a9f-a84f-10bd404c890d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:00:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:54 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.566s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:54 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:00:54 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Deleted volume successfully. Sep 11 23:00:54 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 Sep 11 23:00:54 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f608697d-b8f3-4594-a7f1-63e08699ab80 tempest-DeleteServersTestJSON-94626041 None] Lock "cinder-fece70a3-b1ae-4ff9-8550-e7f8bf276512-delete_volume" released by "delete_volume" :: held 5.508s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:00:55 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8" returned: 0 in 1.049s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:55 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8 Sep 11 23:00:55 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:55 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8500ba42-25af-434b-a8d7-e2c528d8def8" returned: 0 in 0.605s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Lock "cinder-quobyte-8500ba42-25af-434b-a8d7-e2c528d8def8" released by "delete_volume" :: held 1.788s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:00:55 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Created reservations ['f7a90dd5-8677-40f3-b03e-bc2e2956c59c', '0d5cc4eb-4d66-4771-b693-4044b872a9cc', '0d375c65-ca12-4804-80ba-5d7d21923420', '1173370e-1b07-4b6c-a094-8c07b60d35fc'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:00:56 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:00:56 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:00:56 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.487s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:00:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Deleted volume successfully. Sep 11 23:00:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c222fb30-f323-4146-9506-951102dd827d tempest-VolumesAdminNegativeTest-23486467 None] Lock "cinder-8500ba42-25af-434b-a8d7-e2c528d8def8-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:06 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=22,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:06 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=20,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:11 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:01:11 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:11 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.518s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 8 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:01:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:01:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-1d2ce7bd-a9ee-492c-a04d-693f93a22caa req-d8052bb2-e437-4f1c-a07e-307705aa4a4b tempest-TaggedAttachmentsTest-1423741794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-1d2ce7bd-a9ee-492c-a04d-693f93a22caa req-d8052bb2-e437-4f1c-a07e-307705aa4a4b tempest-TaggedAttachmentsTest-1423741794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-1d2ce7bd-a9ee-492c-a04d-693f93a22caa req-d8052bb2-e437-4f1c-a07e-307705aa4a4b tempest-TaggedAttachmentsTest-1423741794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-1d2ce7bd-a9ee-492c-a04d-693f93a22caa req-d8052bb2-e437-4f1c-a07e-307705aa4a4b tempest-TaggedAttachmentsTest-1423741794 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-408debc5-4e42-43b3-a405-1f11d4a6d222', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a04d6778-8289-4f61-86d0-a2efbe6d2d32', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:01:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-1d2ce7bd-a9ee-492c-a04d-693f93a22caa req-d8052bb2-e437-4f1c-a07e-307705aa4a4b tempest-TaggedAttachmentsTest-1423741794 None] attachment_update completed successfully. Sep 11 23:01:31 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-f9f43774-bb50-4a9f-bc53-be4cf68c2257 req-5c99982b-bd0e-4c9b-b40b-e3d2c25b1241 tempest-TaggedAttachmentsTest-1423741794 None] Terminate volume connection completed successfully. Sep 11 23:01:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-f9f43774-bb50-4a9f-bc53-be4cf68c2257 req-5c99982b-bd0e-4c9b-b40b-e3d2c25b1241 tempest-TaggedAttachmentsTest-1423741794 None] Deleting attachment a04d6778-8289-4f61-86d0-a2efbe6d2d32. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:01:41 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=1,cinder:SELECT=9 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:41 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Flow 'volume_create_manager' (65c0e045-8996-4a73-bfce-7ca3bbd340b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e962481a-46fd-4f64-82e6-85ecae038967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e962481a-46fd-4f64-82e6-85ecae038967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-722493465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f082b268-8c58-4e8c-8f52-9f0c3c43d1ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea49e38faae74eb98cda83707e3d4cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:43Z,use_quota=True,user_id='9a1b01bc9fb74f52b4dd934069857724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc3ecf9-46bb-4c9a-b5d8-0bdebcec87a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc3ecf9-46bb-4c9a-b5d8-0bdebcec87a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7eb9ec-8d03-44f2-81ce-a4e2a6edb2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7eb9ec-8d03-44f2-81ce-a4e2a6edb2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f082b268-8c58-4e8c-8f52-9f0c3c43d1ac', 'volume_name': 'volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8438b5ab-6414-4b1f-961a-e1b5be854cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8438b5ab-6414-4b1f-961a-e1b5be854cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1125521c-d5cf-41ad-b5f0-adc48646e7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Volume f082b268-8c58-4e8c-8f52-9f0c3c43d1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac', 'volume_size': 1} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-722493465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f082b268-8c58-4e8c-8f52-9f0c3c43d1ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea49e38faae74eb98cda83707e3d4cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:43Z,use_quota=True,user_id='9a1b01bc9fb74f52b4dd934069857724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Creating volume f082b268-8c58-4e8c-8f52-9f0c3c43d1ac {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:01:43 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:01:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:43 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac 1073741824 Sep 11 23:01:43 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:44 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac 1073741824" returned: 0 in 0.982s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:44 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac Sep 11 23:01:44 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:45 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac" returned: 0 in 0.359s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:01:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1125521c-d5cf-41ad-b5f0-adc48646e7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e1910d-ddda-4e32-8980-6048fd435538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Volume volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac (f082b268-8c58-4e8c-8f52-9f0c3c43d1ac): created successfully Sep 11 23:01:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e1910d-ddda-4e32-8980-6048fd435538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Flow 'volume_create_manager' (65c0e045-8996-4a73-bfce-7ca3bbd340b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a6bb457c-d4e9-40fe-9604-549b107191b2 tempest-VolumesTestJSON-1880097291 None] Created volume successfully. Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Flow 'volume_create_manager' (c0c162a3-b5c9-4bac-b108-8900c9df7077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e95382-4c30-40d6-a3f1-61d26a2227f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e95382-4c30-40d6-a3f1-61d26a2227f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1619146011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9619e320-8e1c-4b22-8f15-34f47527a0cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea49e38faae74eb98cda83707e3d4cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:48Z,use_quota=True,user_id='9a1b01bc9fb74f52b4dd934069857724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c9db2b-0868-4720-bc28-d464a56998b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c9db2b-0868-4720-bc28-d464a56998b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f132ba2f-11b3-44cf-a15f-7bf64062bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f132ba2f-11b3-44cf-a15f-7bf64062bf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9619e320-8e1c-4b22-8f15-34f47527a0cf', 'volume_name': 'volume-9619e320-8e1c-4b22-8f15-34f47527a0cf', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e8220d-01f9-4a19-9cc3-ec6f78a8d1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e8220d-01f9-4a19-9cc3-ec6f78a8d1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0720f543-bd29-4591-a83e-d6b08b152ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:48 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Volume 9619e320-8e1c-4b22-8f15-34f47527a0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9619e320-8e1c-4b22-8f15-34f47527a0cf', 'volume_size': 1} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1619146011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9619e320-8e1c-4b22-8f15-34f47527a0cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea49e38faae74eb98cda83707e3d4cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:48Z,use_quota=True,user_id='9a1b01bc9fb74f52b4dd934069857724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Creating volume 9619e320-8e1c-4b22-8f15-34f47527a0cf {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:01:48 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:01:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:48 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf 1073741824 Sep 11 23:01:48 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:49 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf 1073741824" returned: 0 in 1.050s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:49 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf Sep 11 23:01:49 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:49 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf" returned: 0 in 0.360s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:01:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0720f543-bd29-4591-a83e-d6b08b152ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9619e320-8e1c-4b22-8f15-34f47527a0cf', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e965e9-fdb2-4b40-99cc-55181edb00ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:50 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Volume volume-9619e320-8e1c-4b22-8f15-34f47527a0cf (9619e320-8e1c-4b22-8f15-34f47527a0cf): created successfully Sep 11 23:01:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e965e9-fdb2-4b40-99cc-55181edb00ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Flow 'volume_create_manager' (c0c162a3-b5c9-4bac-b108-8900c9df7077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e9ed7aa7-fccb-4279-a6d6-f7d118feddc0 tempest-VolumesTestJSON-1880097291 None] Created volume successfully. Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Flow 'volume_create_manager' (db030dc8-98bb-4900-a3bf-a102873c63f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293a07b9-0fc3-4a92-951c-53bdb6ddf27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293a07b9-0fc3-4a92-951c-53bdb6ddf27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-679850123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fa7735-3948-434b-8ca3-14c309977493,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea49e38faae74eb98cda83707e3d4cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:51Z,use_quota=True,user_id='9a1b01bc9fb74f52b4dd934069857724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fced8e6-475d-42fb-9784-c71e52f0410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fced8e6-475d-42fb-9784-c71e52f0410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda6cc0b-d561-43f5-9101-2f33bdfe2931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda6cc0b-d561-43f5-9101-2f33bdfe2931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fa7735-3948-434b-8ca3-14c309977493', 'volume_name': 'volume-35fa7735-3948-434b-8ca3-14c309977493', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99973154-eb18-4e5c-a621-dec988a7daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99973154-eb18-4e5c-a621-dec988a7daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625340de-ed1e-4472-aecc-25cccc95d11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:51 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Volume 35fa7735-3948-434b-8ca3-14c309977493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fa7735-3948-434b-8ca3-14c309977493', 'volume_size': 1} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-679850123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fa7735-3948-434b-8ca3-14c309977493,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea49e38faae74eb98cda83707e3d4cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:51Z,use_quota=True,user_id='9a1b01bc9fb74f52b4dd934069857724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Creating volume 35fa7735-3948-434b-8ca3-14c309977493 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:01:51 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:01:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:51 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 1073741824 Sep 11 23:01:51 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:52 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 1073741824" returned: 0 in 0.923s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:52 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 Sep 11 23:01:52 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:52 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493" returned: 0 in 0.362s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625340de-ed1e-4472-aecc-25cccc95d11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fa7735-3948-434b-8ca3-14c309977493', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf9920d-70d5-4009-ae7b-1216a0a867ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Volume volume-35fa7735-3948-434b-8ca3-14c309977493 (35fa7735-3948-434b-8ca3-14c309977493): created successfully Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf9920d-70d5-4009-ae7b-1216a0a867ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Flow 'volume_create_manager' (db030dc8-98bb-4900-a3bf-a102873c63f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8d1f8fbd-82af-4a92-b6be-e5cfaf3ebb75 tempest-VolumesTestJSON-1880097291 None] Created volume successfully. Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Flow 'volume_create_manager' (fce89c2b-0d23-449e-bca6-d7d7bbd50c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4ab78c-faad-4e67-a4b6-7a32b0e3a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4ab78c-faad-4e67-a4b6-7a32b0e3a214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-771331154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5aeaea-eae1-4efc-808e-8b66fa229fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c22e652da5549a8b064c8da000d5113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:54Z,use_quota=True,user_id='8110ab8faad74e6bbfcf7235bc88a8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564d82bf-c93c-4fa6-bba7-2bbe853a06a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564d82bf-c93c-4fa6-bba7-2bbe853a06a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49c8ef9-4bbf-4646-bdbf-d37300b54c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49c8ef9-4bbf-4646-bdbf-d37300b54c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d5aeaea-eae1-4efc-808e-8b66fa229fc7', 'volume_name': 'volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2adab69-effc-44f4-9191-6f220bac06a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2adab69-effc-44f4-9191-6f220bac06a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85da7ff3-ae17-4d50-a5fa-4fcfdf9dfe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:54 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Volume 0d5aeaea-eae1-4efc-808e-8b66fa229fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7', 'volume_size': 1} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-771331154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5aeaea-eae1-4efc-808e-8b66fa229fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c22e652da5549a8b064c8da000d5113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:54Z,use_quota=True,user_id='8110ab8faad74e6bbfcf7235bc88a8b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Creating volume 0d5aeaea-eae1-4efc-808e-8b66fa229fc7 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:01:54 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:54 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 1073741824 Sep 11 23:01:54 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Acquiring lock "cinder-408debc5-4e42-43b3-a405-1f11d4a6d222-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Lock "cinder-408debc5-4e42-43b3-a405-1f11d4a6d222-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Acquiring lock "cinder-quobyte-408debc5-4e42-43b3-a405-1f11d4a6d222" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Lock "cinder-quobyte-408debc5-4e42-43b3-a405-1f11d4a6d222" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a5cbfc-4033-4883-95a6-7aa91a4e3206]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:55 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "cinder-35fa7735-3948-434b-8ca3-14c309977493-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 1073741824" returned: 0 in 1.052s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-35fa7735-3948-434b-8ca3-14c309977493-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:55 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 Sep 11 23:01:55 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 Sep 11 23:01:55 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:55 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "cinder-quobyte-35fa7735-3948-434b-8ca3-14c309977493" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-quobyte-35fa7735-3948-434b-8ca3-14c309977493" acquired by "delete_volume" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35ccf93-d481-4d9f-93b1-5bbea982c788]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:55 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 Sep 11 23:01:55 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:55 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7" returned: 0 in 0.415s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85da7ff3-ae17-4d50-a5fa-4fcfdf9dfe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4280eb7-1f96-4dba-ad85-6f834551fba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:01:55 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Volume volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 (0d5aeaea-eae1-4efc-808e-8b66fa229fc7): created successfully Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4280eb7-1f96-4dba-ad85-6f834551fba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Flow 'volume_create_manager' (fce89c2b-0d23-449e-bca6-d7d7bbd50c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:01:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3a9ef0c5-ff50-463d-abda-08beb74cbef9 tempest-ServerRescueNegativeTestJSON-236369085 None] Created volume successfully. Sep 11 23:01:55 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222" returned: 0 in 0.713s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:55 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222 Sep 11 23:01:55 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:55 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493" returned: 0 in 0.585s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:55 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493 Sep 11 23:01:55 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:56 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-408debc5-4e42-43b3-a405-1f11d4a6d222" returned: 0 in 0.389s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Lock "cinder-quobyte-408debc5-4e42-43b3-a405-1f11d4a6d222" released by "delete_volume" :: held 1.180s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Created reservations ['e4334417-b114-452c-ab57-85f5f79074c7', 'b1f44f21-402d-4252-b8e0-9699f8874046', '28228345-a870-4cef-ab07-ab7fa33c990b', 'fa636779-941e-46dc-aed1-9e717470a375'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:01:56 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-35fa7735-3948-434b-8ca3-14c309977493" returned: 0 in 0.351s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-quobyte-35fa7735-3948-434b-8ca3-14c309977493" released by "delete_volume" :: held 1.000s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:56 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:01:56 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Created reservations ['3b24e524-338d-4d7c-ad6c-8a31b9e3c9d9', '226c983e-4fd8-4698-88c3-84bbce5beea8', 'a543bf3f-039e-4aa9-b7ab-28ebd8c43651', '6641b641-35da-4337-a446-fa7fe7daf6e6'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:56 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:01:56 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:56 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.339s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:01:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Deleted volume successfully. Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa6bed20-a701-4530-8ecc-a41db00c255b tempest-TaggedAttachmentsTest-1423741794 None] Lock "cinder-408debc5-4e42-43b3-a405-1f11d4a6d222-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:56 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.324s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:01:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Deleted volume successfully. Sep 11 23:01:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ac30edd2-d00b-43a3-82b9-49027e09b389 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-35fa7735-3948-434b-8ca3-14c309977493-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "cinder-9619e320-8e1c-4b22-8f15-34f47527a0cf-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-9619e320-8e1c-4b22-8f15-34f47527a0cf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "cinder-quobyte-9619e320-8e1c-4b22-8f15-34f47527a0cf" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-quobyte-9619e320-8e1c-4b22-8f15-34f47527a0cf" acquired by "delete_volume" :: waited 0.049s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:01:57 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[316eb461-4ca6-4e14-8ea6-980eca653ca3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:01:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:57 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf Sep 11 23:01:57 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:58 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf" returned: 0 in 0.666s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:58 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf Sep 11 23:01:58 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:58 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9619e320-8e1c-4b22-8f15-34f47527a0cf" returned: 0 in 0.350s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-quobyte-9619e320-8e1c-4b22-8f15-34f47527a0cf" released by "delete_volume" :: held 1.111s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:58 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Created reservations ['6fa25f83-f997-40f6-b350-0370d85a760d', 'ff2efe84-fd78-4411-b7e9-69959e701923', 'b7667a80-1de3-4c13-902d-a8246f0510d1', 'fc87da59-d590-4065-9b52-5bb8dc53f572'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:01:59 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:01:59 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:01:59 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.487s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:01:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Deleted volume successfully. Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b92e0193-0a4c-41a3-9320-4faa20004fa5 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-9619e320-8e1c-4b22-8f15-34f47527a0cf-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "cinder-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:01:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "cinder-quobyte-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-quobyte-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac" acquired by "delete_volume" :: waited 0.046s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:00 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d51daf5-b7db-4ae4-9b4a-6868bed5c65b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:00 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac Sep 11 23:02:00 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:00 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac" returned: 0 in 0.625s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:00 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac Sep 11 23:02:00 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:01 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac" returned: 0 in 0.448s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-quobyte-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac" released by "delete_volume" :: held 1.190s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Created reservations ['62654d06-1945-4584-810c-6602e75dd105', 'de7b0d51-c1f0-450b-a744-15ba277974e8', '733a774a-32cb-4fe4-a108-fa2668ddb5cb', '42a4e59a-584f-427d-a23a-fa85f34aab30'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:01 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:02:01 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:01 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.297s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:02:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Deleted volume successfully. Sep 11 23:02:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8963385-f05c-4b84-b3bf-115d0da76349 tempest-VolumesTestJSON-1880097291 None] Lock "cinder-f082b268-8c58-4e8c-8f52-9f0c3c43d1ac-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Flow 'volume_create_manager' (f2477ba0-1989-4402-8570-a0e0392be034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b3e965-9af4-483b-afbd-a3110526e009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b3e965-9af4-483b-afbd-a3110526e009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1150417283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9bb8e8-af60-4616-9998-80f5b30b8261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e19dd6452094f76a2be52cead8f2bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:07Z,use_quota=True,user_id='56de0794004b4794bfa9ab314675bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e7e931-0416-4cbb-842b-6c5e8f5e2c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e7e931-0416-4cbb-842b-6c5e8f5e2c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebac064-218a-4532-aa34-3a0cf87fd5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebac064-218a-4532-aa34-3a0cf87fd5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9bb8e8-af60-4616-9998-80f5b30b8261', 'volume_name': 'volume-8b9bb8e8-af60-4616-9998-80f5b30b8261', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ec5d4b-c6fe-41e1-bcc2-ff4a490cd2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ec5d4b-c6fe-41e1-bcc2-ff4a490cd2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56543b2d-afc6-4bbd-9179-8ffe0a631597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:06 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Volume 8b9bb8e8-af60-4616-9998-80f5b30b8261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9bb8e8-af60-4616-9998-80f5b30b8261', 'volume_size': 1} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1150417283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9bb8e8-af60-4616-9998-80f5b30b8261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e19dd6452094f76a2be52cead8f2bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:07Z,use_quota=True,user_id='56de0794004b4794bfa9ab314675bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Creating volume 8b9bb8e8-af60-4616-9998-80f5b30b8261 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:02:06 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:02:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:06 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 1073741824 Sep 11 23:02:06 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:07 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 1073741824" returned: 0 in 0.916s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:07 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 Sep 11 23:02:07 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:08 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261" returned: 0 in 0.480s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56543b2d-afc6-4bbd-9179-8ffe0a631597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9bb8e8-af60-4616-9998-80f5b30b8261', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f7798f-eda4-47e2-ba0e-59ff45b55cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:08 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Volume volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 (8b9bb8e8-af60-4616-9998-80f5b30b8261): created successfully Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f7798f-eda4-47e2-ba0e-59ff45b55cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Flow 'volume_create_manager' (f2477ba0-1989-4402-8570-a0e0392be034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:08 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-71b5e1a5-3be5-484c-a6f1-54372b086d54 tempest-ServerActionsTestOtherA-877327324 None] Created volume successfully. Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Acquiring lock "cinder-0d5aeaea-eae1-4efc-808e-8b66fa229fc7-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "cinder-0d5aeaea-eae1-4efc-808e-8b66fa229fc7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Acquiring lock "cinder-quobyte-0d5aeaea-eae1-4efc-808e-8b66fa229fc7" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "cinder-quobyte-0d5aeaea-eae1-4efc-808e-8b66fa229fc7" acquired by "delete_volume" :: waited 0.040s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e257e-d539-4430-a7f8-7985bdd36ba2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:09 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 Sep 11 23:02:09 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:09 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7" returned: 0 in 0.788s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:09 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7 Sep 11 23:02:09 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:10 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0d5aeaea-eae1-4efc-808e-8b66fa229fc7" returned: 0 in 0.419s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "cinder-quobyte-0d5aeaea-eae1-4efc-808e-8b66fa229fc7" released by "delete_volume" :: held 1.301s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Created reservations ['c8db069e-02cc-426b-b189-664dd792a90b', '951a8777-9eaf-4eb8-bac9-00c9e550375c', '24c46ec8-24c9-4824-81cc-f6a13b63ecd2', 'ca70b09f-7ed6-4d3c-b600-487be019df23'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:10 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:02:10 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:10 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.506s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:10 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:02:10 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Deleted volume successfully. Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-96d346d2-0308-4747-835f-29027246bb71 tempest-ServerRescueNegativeTestJSON-236369085 None] Lock "cinder-0d5aeaea-eae1-4efc-808e-8b66fa229fc7-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:11 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:02:11 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:11 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.424s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:02:20 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=30,cinder:UPDATE=48,cinder:INSERT=9,cinder:DELETE=4 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:02:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a8d74179-8be7-487e-95f8-f69cb4dfdc12 tempest-GroupSnapshotsTest-431167596 None] Group tempest-GroupSnapshotsTest-Group-433423352: creating Sep 11 23:02:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a8d74179-8be7-487e-95f8-f69cb4dfdc12 tempest-GroupSnapshotsTest-431167596 None] Group tempest-GroupSnapshotsTest-Group-433423352: created successfully Sep 11 23:02:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a8d74179-8be7-487e-95f8-f69cb4dfdc12 tempest-GroupSnapshotsTest-431167596 None] Create group completed successfully. Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Flow 'volume_create_manager' (dc24fe1a-41ea-49a2-b40d-bbe5113af783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5b5397-a7b8-491a-a021-d69e5caae423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5b5397-a7b8-491a-a021-d69e5caae423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906944607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89eb9a68-e3d6-479c-998d-090a28089277,host='devstack@QuobyteHD#QuobyteHD',id=aea3e627-6697-4c4b-981b-732524f71b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd82c66ab0a4136b24660624fa22e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:22Z,use_quota=True,user_id='53b4dd7c2d194219b97c7cfb3d86c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82c69078-43e6-4f81-a7d8-485484efa7e6),volume_type_id=82c69078-43e6-4f81-a7d8-485484efa7e6)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bf6591-53a5-4f83-83f8-292b0b45de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bf6591-53a5-4f83-83f8-292b0b45de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d75e280-a653-44ed-a76d-07f66606f200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d75e280-a653-44ed-a76d-07f66606f200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea3e627-6697-4c4b-981b-732524f71b95', 'volume_name': 'volume-aea3e627-6697-4c4b-981b-732524f71b95', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51556e80-6b1f-453d-a066-76774ed21625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51556e80-6b1f-453d-a066-76774ed21625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e21348-48ed-4dbc-86b8-e8e0907b4ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:22 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Volume aea3e627-6697-4c4b-981b-732524f71b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea3e627-6697-4c4b-981b-732524f71b95', 'volume_size': 1} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89eb9a68-e3d6-479c-998d-090a28089277,created_at=2026-09-11T21:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906944607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89eb9a68-e3d6-479c-998d-090a28089277,host='devstack@QuobyteHD#QuobyteHD',id=aea3e627-6697-4c4b-981b-732524f71b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd82c66ab0a4136b24660624fa22e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:22Z,use_quota=True,user_id='53b4dd7c2d194219b97c7cfb3d86c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82c69078-43e6-4f81-a7d8-485484efa7e6),volume_type_id=82c69078-43e6-4f81-a7d8-485484efa7e6)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Creating volume aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:02:22 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:02:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:22 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 1073741824 Sep 11 23:02:22 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:23 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 1073741824" returned: 0 in 0.550s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:23 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 Sep 11 23:02:23 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:23 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95" returned: 0 in 0.252s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e21348-48ed-4dbc-86b8-e8e0907b4ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea3e627-6697-4c4b-981b-732524f71b95', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40e4750-2324-4124-9617-a1b61a868fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:23 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Volume volume-aea3e627-6697-4c4b-981b-732524f71b95 (aea3e627-6697-4c4b-981b-732524f71b95): created successfully Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40e4750-2324-4124-9617-a1b61a868fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Flow 'volume_create_manager' (dc24fe1a-41ea-49a2-b40d-bbe5113af783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:23 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2bee11e7-7ae2-4e57-a978-d336ee7d7176 tempest-GroupSnapshotsTest-431167596 None] Created volume successfully. Sep 11 23:02:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] GroupSnapshot 0335a9ad-64a2-4777-b3b7-277e49ddf915: creating. Sep 11 23:02:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Group snapshot 0335a9ad-64a2-4777-b3b7-277e49ddf915: creating. {{(pid=88026) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 23:02:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Creating offline snapshot 97f5d6a2-95a6-4b09-a2e3-2e400d25740e of volume aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:02:24 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf1f277-740a-49bc-8b92-c92271b22ae6]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:24 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 Sep 11 23:02:24 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:24 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95" returned: 0 in 0.430s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:24 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e 1G Sep 11 23:02:24 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:25 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e 1G" returned: 0 in 0.597s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea3e627-6697-4c4b-981b-732524f71b95 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:25 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea3e627-6697-4c4b-981b-732524f71b95 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e Sep 11 23:02:25 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:26 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea3e627-6697-4c4b-981b-732524f71b95 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e" returned: 0 in 0.740s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:26 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:02:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:26 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e Sep 11 23:02:26 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:26 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e" returned: 0 in 0.335s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:26 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.info Sep 11 23:02:26 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:26 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.info" returned: 0 in 0.457s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:26 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:02:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:26 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.info Sep 11 23:02:26 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:27 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.info" returned: 0 in 0.364s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.054s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:27 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-792f0215-a4f9-4599-be4c-0483f1798eb0 tempest-GroupSnapshotsTest-431167596 None] group_snapshot 0335a9ad-64a2-4777-b3b7-277e49ddf915: created successfully Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-97f5d6a2-95a6-4b09-a2e3-2e400d25740e-0420b80f-7aef-4760-ba2d-23bc030ad1af" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-97f5d6a2-95a6-4b09-a2e3-2e400d25740e-0420b80f-7aef-4760-ba2d-23bc030ad1af" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Creating volume 0420b80f-7aef-4760-ba2d-23bc030ad1af from snapshot 97f5d6a2-95a6-4b09-a2e3-2e400d25740e {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-0420b80f-7aef-4760-ba2d-23bc030ad1af" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-0420b80f-7aef-4760-ba2d-23bc030ad1af" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] snapshot: 97f5d6a2-95a6-4b09-a2e3-2e400d25740e, volume: 0420b80f-7aef-4760-ba2d-23bc030ad1af, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49286a-d6c7-4daa-9f1c-af891e61cd46]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:30 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e Sep 11 23:02:30 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:30 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e" returned: 0 in 0.683s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea3e627-6697-4c4b-981b-732524f71b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f252c49e-1208-4eb3-8f6d-86aa7e8b13b2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:30 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 Sep 11 23:02:30 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:31 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95" returned: 0 in 0.647s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:02:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:02:31 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:02:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:31 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af Sep 11 23:02:31 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:39 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af" returned: 0 in 7.719s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:39 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95, size 1024.00 MB, duration 7.72 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:02:39 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Converted 1024.00 MB image at 132.61 MB/s Sep 11 23:02:39 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:02:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:39 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af Sep 11 23:02:39 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:39 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af" returned: 0 in 0.395s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-0420b80f-7aef-4760-ba2d-23bc030ad1af" released by "_copy_volume_from_snapshot" :: held 9.582s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-97f5d6a2-95a6-4b09-a2e3-2e400d25740e-0420b80f-7aef-4760-ba2d-23bc030ad1af" released by "_create_volume_from_snapshot" :: held 9.737s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.767s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:39 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-adf602b1-2a66-425a-9071-31764fc03df4 tempest-GroupSnapshotsTest-431167596 None] Create group from source-snapshot-0335a9ad-64a2-4777-b3b7-277e49ddf915 completed successfully. Sep 11 23:02:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-0420b80f-7aef-4760-ba2d-23bc030ad1af" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-0420b80f-7aef-4760-ba2d-23bc030ad1af" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:41 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f808d-209f-454d-a1ee-24d196c612a3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:41 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af Sep 11 23:02:41 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:41 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af" returned: 0 in 0.417s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:42 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af Sep 11 23:02:42 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:42 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0420b80f-7aef-4760-ba2d-23bc030ad1af" returned: 0 in 0.409s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-0420b80f-7aef-4760-ba2d-23bc030ad1af" released by "delete_volume" :: held 0.889s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=68,cinder:SELECT=58,cinder:DELETE=7,cinder:INSERT=17 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['f7da2f82-983c-422f-ba1d-db1af847d2d5'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:02:42 devstack cinder-volume[88026]: WARNING cinder.quota [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-374453084 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-374453084, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:02:42 devstack cinder-volume[88026]: WARNING cinder.quota [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-374453084 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-374453084, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['fd3c7e55-7b20-4d6c-9c9f-6c29223d8c4f', '2723a018-eee3-426e-8ee5-c289d89e61f5', '75569f82-b02b-4f72-9f3a-95eb7ca76850', '8fea9155-dbd2-40fb-8da9-d184b1e14b4c'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:42 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:02:42 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] group_snapshot 0335a9ad-64a2-4777-b3b7-277e49ddf915: deleting Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] group_snapshot 0335a9ad-64a2-4777-b3b7-277e49ddf915: deleting {{(pid=88026) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-aea3e627-6697-4c4b-981b-732524f71b95" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-aea3e627-6697-4c4b-981b-732524f71b95" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-97f5d6a2-95a6-4b09-a2e3-2e400d25740e" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-97f5d6a2-95a6-4b09-a2e3-2e400d25740e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Deleting offline snapshot 97f5d6a2-95a6-4b09-a2e3-2e400d25740e of volume aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] snapshot_file for this snap is: volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee04a59-d340-4a44-a35c-56575b1b8ac4]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:43 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.422s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:02:43 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-13a466b1-36b5-45b6-a987-d2ef9bfe3aa9 tempest-GroupSnapshotsTest-431167596 None] Delete group completed successfully. Sep 11 23:02:43 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e Sep 11 23:02:43 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:43 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e" returned: 0 in 0.543s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea3e627-6697-4c4b-981b-732524f71b95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f50ee1-a935-4da6-aff4-cb2f57ff4bac]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:43 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 Sep 11 23:02:43 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:44 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95" returned: 0 in 0.681s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:44 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e Sep 11 23:02:44 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:44 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e" returned: 0 in 0.458s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:44 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e Sep 11 23:02:44 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:45 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95.97f5d6a2-95a6-4b09-a2e3-2e400d25740e" returned: 0 in 0.272s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-97f5d6a2-95a6-4b09-a2e3-2e400d25740e" released by "_delete_snapshot" :: held 2.154s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-aea3e627-6697-4c4b-981b-732524f71b95" released by "delete_snapshot" :: held 2.190s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:45 devstack cinder-volume[88026]: WARNING cinder.quota [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-374453084 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-374453084, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:02:45 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['729e0548-e71c-425b-bf4f-192d72e44465', '293eb589-cea5-4c58-ae2b-60ddfeaf1bae', '39b007fa-85bb-47b8-b012-c8e98370c381', 'c07422af-b132-4518-aa37-6bd65862c690'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:02:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-987f9241-0e21-4347-bdd6-628cf1727080 tempest-GroupSnapshotsTest-431167596 None] group_snapshot 0335a9ad-64a2-4777-b3b7-277e49ddf915: deleted successfully Sep 11 23:02:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-aea3e627-6697-4c4b-981b-732524f71b95" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:02:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-aea3e627-6697-4c4b-981b-732524f71b95" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:02:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0c914-cba8-4bdc-84c5-351685a6ef78]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:02:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:47 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 Sep 11 23:02:47 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:47 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95" returned: 0 in 0.525s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:47 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95 Sep 11 23:02:47 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:47 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aea3e627-6697-4c4b-981b-732524f71b95" returned: 0 in 0.352s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-aea3e627-6697-4c4b-981b-732524f71b95" released by "delete_volume" :: held 1.000s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:02:47 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Created reservations ['b7ea89ac-1f8e-46eb-bc83-09bbb1fd9b93'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:02:48 devstack cinder-volume[88026]: WARNING cinder.db.api [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-374453084'] Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Created reservations ['76152f6f-030a-49be-af3e-4ae72307891e', '3b566747-3b2c-423d-be7d-b13a84201367', '0a44b371-7706-4c24-bdfb-b4d490f82556', '8c91b467-f68e-4b78-b996-c308651005bd'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:48 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:02:48 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:48 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.319s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:48 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:02:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-244542f4-52fa-4682-ab91-07d12de4554c tempest-GroupSnapshotsTest-431167596 None] Delete group completed successfully. Sep 11 23:02:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3121c2b3-ced8-46b0-9dab-d8156d7d65b7 tempest-GroupSnapshotsTest-431167596 None] Group tempest-GroupSnapshotsTest-Group-45062070: creating Sep 11 23:02:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3121c2b3-ced8-46b0-9dab-d8156d7d65b7 tempest-GroupSnapshotsTest-431167596 None] Group tempest-GroupSnapshotsTest-Group-45062070: created successfully Sep 11 23:02:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3121c2b3-ced8-46b0-9dab-d8156d7d65b7 tempest-GroupSnapshotsTest-431167596 None] Create group completed successfully. Sep 11 23:02:51 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Flow 'volume_create_manager' (d253851d-6ed1-471b-a347-20b2dd50b970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a64fa0-a082-4ac2-9e3f-40ccd3affd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a64fa0-a082-4ac2-9e3f-40ccd3affd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-943721841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecb20059-0e31-4f6a-b444-f084f7e61ca9,host='devstack@QuobyteHD#QuobyteHD',id=da8fe884-33db-499b-907a-9a61f2dab20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd82c66ab0a4136b24660624fa22e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:52Z,use_quota=True,user_id='53b4dd7c2d194219b97c7cfb3d86c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bb7ee6b-a44d-4eb2-a785-cf978bf21af2),volume_type_id=5bb7ee6b-a44d-4eb2-a785-cf978bf21af2)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014dc0c7-ebb1-4bef-8e92-1fe8762c1dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014dc0c7-ebb1-4bef-8e92-1fe8762c1dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770e5fff-f13e-4cd6-b73a-22716bc65586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770e5fff-f13e-4cd6-b73a-22716bc65586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8fe884-33db-499b-907a-9a61f2dab20c', 'volume_name': 'volume-da8fe884-33db-499b-907a-9a61f2dab20c', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f97c14a-973b-48fa-90e0-a69d2093f8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f97c14a-973b-48fa-90e0-a69d2093f8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa883cc-eb2c-46f1-865e-26763a04de91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Volume da8fe884-33db-499b-907a-9a61f2dab20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8fe884-33db-499b-907a-9a61f2dab20c', 'volume_size': 1} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ecb20059-0e31-4f6a-b444-f084f7e61ca9,created_at=2026-09-11T21:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-943721841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecb20059-0e31-4f6a-b444-f084f7e61ca9,host='devstack@QuobyteHD#QuobyteHD',id=da8fe884-33db-499b-907a-9a61f2dab20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd82c66ab0a4136b24660624fa22e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:52Z,use_quota=True,user_id='53b4dd7c2d194219b97c7cfb3d86c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bb7ee6b-a44d-4eb2-a785-cf978bf21af2),volume_type_id=5bb7ee6b-a44d-4eb2-a785-cf978bf21af2)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Creating volume da8fe884-33db-499b-907a-9a61f2dab20c {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:02:52 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:02:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:52 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c 1073741824 Sep 11 23:02:52 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3ae2f67c-eb78-4940-a2af-a29015c01b72 req-552aeb5c-6aec-4fe9-86d7-cb717e506aaa tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:53 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c 1073741824" returned: 0 in 0.905s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:53 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c Sep 11 23:02:53 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:53 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c" returned: 0 in 0.542s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3ae2f67c-eb78-4940-a2af-a29015c01b72 req-552aeb5c-6aec-4fe9-86d7-cb717e506aaa tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.611s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3ae2f67c-eb78-4940-a2af-a29015c01b72 req-552aeb5c-6aec-4fe9-86d7-cb717e506aaa tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa883cc-eb2c-46f1-865e-26763a04de91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8fe884-33db-499b-907a-9a61f2dab20c', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b7ce94-7f8d-4ab5-be45-e0dd329799bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:53 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Volume volume-da8fe884-33db-499b-907a-9a61f2dab20c (da8fe884-33db-499b-907a-9a61f2dab20c): created successfully Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b7ce94-7f8d-4ab5-be45-e0dd329799bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Flow 'volume_create_manager' (d253851d-6ed1-471b-a347-20b2dd50b970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-3ae2f67c-eb78-4940-a2af-a29015c01b72 req-552aeb5c-6aec-4fe9-86d7-cb717e506aaa tempest-ServerActionsTestOtherA-877327324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-8b9bb8e8-af60-4616-9998-80f5b30b8261', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a071bd0-e4f9-44b8-bc1e-598d76bb03a7', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:02:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e2041b1a-52f1-4289-aa97-96c71b36112e tempest-GroupSnapshotsTest-431167596 None] Created volume successfully. Sep 11 23:02:54 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-3ae2f67c-eb78-4940-a2af-a29015c01b72 req-552aeb5c-6aec-4fe9-86d7-cb717e506aaa tempest-ServerActionsTestOtherA-877327324 None] attachment_update completed successfully. Sep 11 23:02:55 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:02:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Flow 'volume_create_manager' (b331e8ce-f8e6-425d-aa8f-59d6a7af5916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9276820c-3e5a-45ce-b3ed-5ef124a16537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9276820c-3e5a-45ce-b3ed-5ef124a16537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-52503286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecb20059-0e31-4f6a-b444-f084f7e61ca9,host='devstack@QuobyteHD#QuobyteHD',id=b143fc73-1f12-4d95-9fdc-dd84d19f92b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd82c66ab0a4136b24660624fa22e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:56Z,use_quota=True,user_id='53b4dd7c2d194219b97c7cfb3d86c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bb7ee6b-a44d-4eb2-a785-cf978bf21af2),volume_type_id=5bb7ee6b-a44d-4eb2-a785-cf978bf21af2)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a0f81f-ecb7-425f-8519-77bc6c94d735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a0f81f-ecb7-425f-8519-77bc6c94d735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a7b565-7e4f-4034-b193-222d9f73069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a7b565-7e4f-4034-b193-222d9f73069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b143fc73-1f12-4d95-9fdc-dd84d19f92b9', 'volume_name': 'volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42505479-e67e-4368-a1ca-c890ad3f853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42505479-e67e-4368-a1ca-c890ad3f853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605307f4-77ab-4bf6-b54a-00e024a891e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:56 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Volume b143fc73-1f12-4d95-9fdc-dd84d19f92b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9', 'volume_size': 1} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ecb20059-0e31-4f6a-b444-f084f7e61ca9,created_at=2026-09-11T21:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-52503286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecb20059-0e31-4f6a-b444-f084f7e61ca9,host='devstack@QuobyteHD#QuobyteHD',id=b143fc73-1f12-4d95-9fdc-dd84d19f92b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd82c66ab0a4136b24660624fa22e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:56Z,use_quota=True,user_id='53b4dd7c2d194219b97c7cfb3d86c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bb7ee6b-a44d-4eb2-a785-cf978bf21af2),volume_type_id=5bb7ee6b-a44d-4eb2-a785-cf978bf21af2)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Creating volume b143fc73-1f12-4d95-9fdc-dd84d19f92b9 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:02:56 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:02:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:56 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 1073741824 Sep 11 23:02:56 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:57 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 1073741824" returned: 0 in 0.841s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:02:57 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 Sep 11 23:02:57 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:02:57 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" returned: 0 in 0.561s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605307f4-77ab-4bf6-b54a-00e024a891e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303bcce2-a457-45b6-beed-632253fd0db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:02:57 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Volume volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 (b143fc73-1f12-4d95-9fdc-dd84d19f92b9): created successfully Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303bcce2-a457-45b6-beed-632253fd0db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:02:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Flow 'volume_create_manager' (b331e8ce-f8e6-425d-aa8f-59d6a7af5916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:02:57 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1f3902fd-d38a-4cd7-b3be-7ba8a64c99af tempest-GroupSnapshotsTest-431167596 None] Created volume successfully. Sep 11 23:02:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b8cace41-1c4b-4e47-81fc-58c5c3dd27a0 tempest-GroupSnapshotsTest-431167596 None] Update group completed successfully. Sep 11 23:02:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-95d35f70-d631-4619-be44-614c3cae3307 req-a1526d11-4639-49d9-833e-bf33938d3ed6 tempest-ServerActionsTestOtherA-877327324 None] Terminate volume connection completed successfully. Sep 11 23:02:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-95d35f70-d631-4619-be44-614c3cae3307 req-a1526d11-4639-49d9-833e-bf33938d3ed6 tempest-ServerActionsTestOtherA-877327324 None] Deleting attachment 3a071bd0-e4f9-44b8-bc1e-598d76bb03a7. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:03:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2d07fe4d-281f-4b6e-9dfb-c5d3b2f0c9dc tempest-GroupSnapshotsTest-431167596 None] Update group completed successfully. Sep 11 23:03:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-95d35f70-d631-4619-be44-614c3cae3307 req-3502a18e-44dd-484b-b0e3-c571337b11eb tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-95d35f70-d631-4619-be44-614c3cae3307 req-3502a18e-44dd-484b-b0e3-c571337b11eb tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-95d35f70-d631-4619-be44-614c3cae3307 req-3502a18e-44dd-484b-b0e3-c571337b11eb tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-95d35f70-d631-4619-be44-614c3cae3307 req-3502a18e-44dd-484b-b0e3-c571337b11eb tempest-ServerActionsTestOtherA-877327324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-8b9bb8e8-af60-4616-9998-80f5b30b8261', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6de4816b-202a-4ac1-9930-98368999c86e', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:03:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-95d35f70-d631-4619-be44-614c3cae3307 req-3502a18e-44dd-484b-b0e3-c571337b11eb tempest-ServerActionsTestOtherA-877327324 None] attachment_update completed successfully. Sep 11 23:03:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cc3a34f4-1000-4a1f-9d49-91b554e8411b tempest-GroupSnapshotsTest-431167596 None] Update group completed successfully. Sep 11 23:03:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-536b3880-d902-4ef0-97ff-9cdf7857ed67 tempest-GroupSnapshotsTest-431167596 None] Update group completed successfully. Sep 11 23:03:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] GroupSnapshot b944ddbe-83f4-493a-84fb-e9b0a9e48670: creating. Sep 11 23:03:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Group snapshot b944ddbe-83f4-493a-84fb-e9b0a9e48670: creating. {{(pid=88026) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 23:03:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Creating offline snapshot 6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 of volume b143fc73-1f12-4d95-9fdc-dd84d19f92b9 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:03:06 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d4fdfd-efc5-4f85-9178-6467680393e5]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:06 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 Sep 11 23:03:06 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:07 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" returned: 0 in 1.092s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:07 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 1G Sep 11 23:03:07 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:08 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 1G" returned: 0 in 0.989s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:08 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 Sep 11 23:03:08 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:09 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1" returned: 0 in 0.614s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:09 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:03:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:09 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 Sep 11 23:03:09 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:09 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1" returned: 0 in 0.422s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:09 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.info Sep 11 23:03:09 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:10 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.info" returned: 0 in 0.449s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:10 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:03:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:10 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.info Sep 11 23:03:10 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:11 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.info" returned: 0 in 0.773s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.569s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Creating offline snapshot ed6f6ded-66a6-4b81-a5b4-965ab0fb843d of volume da8fe884-33db-499b-907a-9a61f2dab20c {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f9d43-b1c3-4e53-80e6-7a4248a9d85b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:11 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:03:11 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:11 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c Sep 11 23:03:11 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:12 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c" returned: 0 in 0.790s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:12 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d 1G Sep 11 23:03:12 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:12 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.839s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 8 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:03:12 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d 1G" returned: 0 in 0.908s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da8fe884-33db-499b-907a-9a61f2dab20c -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:13 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da8fe884-33db-499b-907a-9a61f2dab20c -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d Sep 11 23:03:13 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:13 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da8fe884-33db-499b-907a-9a61f2dab20c -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d" returned: 0 in 0.410s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:13 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:03:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:13 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d Sep 11 23:03:13 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:13 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d" returned: 0 in 0.240s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:13 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.info Sep 11 23:03:13 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:13 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.info" returned: 0 in 0.252s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:13 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:03:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:13 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.info Sep 11 23:03:13 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:14 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.info" returned: 0 in 0.298s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.121s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-454e1ba2-ad65-4863-9b82-b07a4c9e6f82 tempest-GroupSnapshotsTest-431167596 None] group_snapshot b944ddbe-83f4-493a-84fb-e9b0a9e48670: created successfully Sep 11 23:03:15 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] group_snapshot b944ddbe-83f4-493a-84fb-e9b0a9e48670: deleting Sep 11 23:03:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] group_snapshot b944ddbe-83f4-493a-84fb-e9b0a9e48670: deleting {{(pid=88026) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 23:03:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Deleting offline snapshot 6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 of volume b143fc73-1f12-4d95-9fdc-dd84d19f92b9 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:03:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] snapshot_file for this snap is: volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:03:16 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c72ad6-40e4-46f5-a252-a8a42d9a5fd0]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:16 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 Sep 11 23:03:16 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:17 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1" returned: 0 in 1.092s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:03:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[855547b6-800d-4d68-86b3-385bf2247a42]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:17 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 Sep 11 23:03:17 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:18 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" returned: 0 in 1.166s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:18 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 Sep 11 23:03:18 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:19 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1" returned: 0 in 0.839s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:19 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1 Sep 11 23:03:19 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:19 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9.6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1" returned: 0 in 0.391s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-6527febe-e4d7-4b7b-9ed2-54e4a7cc9dc1" released by "_delete_snapshot" :: held 3.652s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" released by "delete_snapshot" :: held 3.701s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-da8fe884-33db-499b-907a-9a61f2dab20c" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-da8fe884-33db-499b-907a-9a61f2dab20c" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-ed6f6ded-66a6-4b81-a5b4-965ab0fb843d" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-ed6f6ded-66a6-4b81-a5b4-965ab0fb843d" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Deleting offline snapshot ed6f6ded-66a6-4b81-a5b4-965ab0fb843d of volume da8fe884-33db-499b-907a-9a61f2dab20c {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] snapshot_file for this snap is: volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[965d3412-4b79-4cb7-8754-2d36f7e57b41]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:20 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d Sep 11 23:03:20 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:20 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d" returned: 0 in 0.501s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da8fe884-33db-499b-907a-9a61f2dab20c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:03:20 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4111df68-16ae-44a1-9e6c-8c7e054747eb]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:20 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c Sep 11 23:03:20 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:20 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c" returned: 0 in 0.472s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:20 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d Sep 11 23:03:20 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:21 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d" returned: 0 in 0.433s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:21 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d Sep 11 23:03:21 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:21 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c.ed6f6ded-66a6-4b81-a5b4-965ab0fb843d" returned: 0 in 0.244s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-ed6f6ded-66a6-4b81-a5b4-965ab0fb843d" released by "_delete_snapshot" :: held 1.798s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-da8fe884-33db-499b-907a-9a61f2dab20c" released by "delete_snapshot" :: held 1.856s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:21 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=73,cinder:UPDATE=60,cinder:INSERT=14,cinder:DELETE=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:03:21 devstack cinder-volume[88026]: WARNING cinder.quota [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-543986444 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-543986444, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:21 devstack cinder-volume[88026]: WARNING cinder.quota [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-543986444 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-543986444, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:21 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['c4092257-4220-4bac-a7d2-a5f249066fbc', 'b755f08b-15bf-444b-9c7d-b04e50940017', '96f25153-0495-4853-a82e-92938604303a', '8195d15d-c7f4-4cf2-a318-ea93e2e1d6d2'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:21 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['2a3316e5-17e6-43a4-be31-5d8d573a418b', '0eeba5f8-c7a4-498f-9f6a-a1655295ecd7', 'e6e5df27-17c0-4ba0-8f7c-9a451be4fc6a', '8f45aa46-eb0a-4ffe-97b7-6d2c3921eb18'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:21 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-65fa70f8-4e52-4a5d-b77f-386ba0e431d4 tempest-GroupSnapshotsTest-431167596 None] group_snapshot b944ddbe-83f4-493a-84fb-e9b0a9e48670: deleted successfully Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Flow 'volume_create_manager' (f0784fe0-61f3-4329-8d8f-54cedf09efec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84a3f82-164f-470a-947c-5984907e457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84a3f82-164f-470a-947c-5984907e457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-790260636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061d220e-1946-4d76-933d-941fc344f46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467171871c32464887bb78cd632acbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:22Z,use_quota=True,user_id='ecbf346b054e4f37b66f61787eaee1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e775310f-a74a-403e-b471-ba270ffab45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e775310f-a74a-403e-b471-ba270ffab45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b04560-2c81-4ef9-bbb6-c8f5907c1b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b04560-2c81-4ef9-bbb6-c8f5907c1b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061d220e-1946-4d76-933d-941fc344f46b', 'volume_name': 'volume-061d220e-1946-4d76-933d-941fc344f46b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19b4a8e-55c2-43b3-b0f6-21ce1446e505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19b4a8e-55c2-43b3-b0f6-21ce1446e505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac296d24-3153-465d-8d68-cbc049b98424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:22 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Volume 061d220e-1946-4d76-933d-941fc344f46b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061d220e-1946-4d76-933d-941fc344f46b', 'volume_size': 1} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-790260636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061d220e-1946-4d76-933d-941fc344f46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467171871c32464887bb78cd632acbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:22Z,use_quota=True,user_id='ecbf346b054e4f37b66f61787eaee1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Creating volume 061d220e-1946-4d76-933d-941fc344f46b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:22 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:22 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b 1073741824 Sep 11 23:03:22 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f904e5-ec2c-4102-9492-b4042f0df9ef]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:22 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 Sep 11 23:03:22 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:23 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b 1073741824" returned: 0 in 0.474s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:23 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b Sep 11 23:03:23 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:23 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" returned: 0 in 0.450s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:23 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9 Sep 11 23:03:23 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:23 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac296d24-3153-465d-8d68-cbc049b98424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061d220e-1946-4d76-933d-941fc344f46b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9764a031-d087-435a-bae2-5f4d827b4c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:23 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Volume volume-061d220e-1946-4d76-933d-941fc344f46b (061d220e-1946-4d76-933d-941fc344f46b): created successfully Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9764a031-d087-435a-bae2-5f4d827b4c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Flow 'volume_create_manager' (f0784fe0-61f3-4329-8d8f-54cedf09efec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:23 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" returned: 0 in 0.330s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-b143fc73-1f12-4d95-9fdc-dd84d19f92b9" released by "delete_volume" :: held 0.883s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-da8fe884-33db-499b-907a-9a61f2dab20c" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:23 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8eac7c40-f648-4ccc-9d65-f7947470c9ed tempest-ServersNegativeTestJSON-404396112 None] Created volume successfully. Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-da8fe884-33db-499b-907a-9a61f2dab20c" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbce93b9-6cb9-454c-a138-a59114588a6e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:23 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c Sep 11 23:03:23 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:24 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c" returned: 0 in 0.388s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:24 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c Sep 11 23:03:24 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:24 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da8fe884-33db-499b-907a-9a61f2dab20c" returned: 0 in 0.256s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-da8fe884-33db-499b-907a-9a61f2dab20c" released by "delete_volume" :: held 0.697s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['c8b13843-30ed-46a5-8477-2564e2d05a93'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:24 devstack cinder-volume[88026]: WARNING cinder.quota [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-543986444 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-543986444, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['e30b1400-07f1-4a2a-8f50-4b172f4481f2', 'dc619b2c-8ff5-4dff-a21e-198c0a40dd22', '30aecca2-423c-40a8-92b3-e152ca8901df', '8a746153-3368-4c12-adef-84d23481ba16'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['cb4851e3-6c0d-4c61-9722-3a0e177c2282', '2c7a5248-4b17-488f-aeb5-9854cb637f24', 'f1a3bdfa-ed0e-4dc0-9396-03462803ff1c', '8951a37a-a56b-4128-9e8f-64b4cb30ed51'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:24 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:03:24 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:24 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.259s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:24 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5cd5bb85-0a73-4974-bc3f-80ca2c544ae7 tempest-GroupSnapshotsTest-431167596 None] Delete group completed successfully. Sep 11 23:03:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6642add1-48b1-4107-a633-9cab920a4930 tempest-GroupSnapshotsTest-431167596 None] Group tempest-GroupSnapshotsTest-Group-1984909816: creating Sep 11 23:03:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6642add1-48b1-4107-a633-9cab920a4930 tempest-GroupSnapshotsTest-431167596 None] Group tempest-GroupSnapshotsTest-Group-1984909816: created successfully Sep 11 23:03:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6642add1-48b1-4107-a633-9cab920a4930 tempest-GroupSnapshotsTest-431167596 None] Create group completed successfully. Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Flow 'volume_create_manager' (4f541798-b9b7-4855-997d-4f7b0657122e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3c1e2a-029b-4d6c-96c5-f8124f97553d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3c1e2a-029b-4d6c-96c5-f8124f97553d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-302920768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58815395-8a39-42e7-80d2-5e0c279aa73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467171871c32464887bb78cd632acbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:26Z,use_quota=True,user_id='ecbf346b054e4f37b66f61787eaee1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c440821-9a93-4489-b0cc-727d5d61e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c440821-9a93-4489-b0cc-727d5d61e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddd62bf-0360-4cc2-a01c-21de9dee2c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ddd62bf-0360-4cc2-a01c-21de9dee2c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58815395-8a39-42e7-80d2-5e0c279aa73a', 'volume_name': 'volume-58815395-8a39-42e7-80d2-5e0c279aa73a', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8222363d-959f-44e1-a671-a282fa183c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8222363d-959f-44e1-a671-a282fa183c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7e3cb8-ea32-48f3-b5f6-c63d8e48f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:25 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Volume 58815395-8a39-42e7-80d2-5e0c279aa73a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58815395-8a39-42e7-80d2-5e0c279aa73a', 'volume_size': 1} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-302920768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58815395-8a39-42e7-80d2-5e0c279aa73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467171871c32464887bb78cd632acbed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:26Z,use_quota=True,user_id='ecbf346b054e4f37b66f61787eaee1e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Creating volume 58815395-8a39-42e7-80d2-5e0c279aa73a {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:26 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:26 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a 1073741824 Sep 11 23:03:26 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:26 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a 1073741824" returned: 0 in 0.397s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:26 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a Sep 11 23:03:26 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:26 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a" returned: 0 in 0.263s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7e3cb8-ea32-48f3-b5f6-c63d8e48f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58815395-8a39-42e7-80d2-5e0c279aa73a', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b94f8f2-358a-408e-9b2b-de46b8cf4d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:26 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Volume volume-58815395-8a39-42e7-80d2-5e0c279aa73a (58815395-8a39-42e7-80d2-5e0c279aa73a): created successfully Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b94f8f2-358a-408e-9b2b-de46b8cf4d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Flow 'volume_create_manager' (4f541798-b9b7-4855-997d-4f7b0657122e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8ea097e1-4063-4314-9d09-46c67fc61d88 tempest-ServersNegativeTestJSON-404396112 None] Created volume successfully. Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Flow 'volume_create_manager' (123716af-825e-4151-b1b7-13d18e99f49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112a63d0-84d1-4db7-a2f5-60b6be4ae64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112a63d0-84d1-4db7-a2f5-60b6be4ae64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680121601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c60ad14e-4973-4a5a-9220-a4eff5ea3960,host='devstack@QuobyteHD#QuobyteHD',id=1d97aa9a-805d-4cb2-b32f-98e1efd798a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd82c66ab0a4136b24660624fa22e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:27Z,use_quota=True,user_id='53b4dd7c2d194219b97c7cfb3d86c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b560f04e-05fd-4575-947e-714c1fbc31fa),volume_type_id=b560f04e-05fd-4575-947e-714c1fbc31fa)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c1fe17-a7e2-4fdd-8ed0-ac17c30e72ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c1fe17-a7e2-4fdd-8ed0-ac17c30e72ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b789b8-2392-4112-9790-de4c296968f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b789b8-2392-4112-9790-de4c296968f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d97aa9a-805d-4cb2-b32f-98e1efd798a0', 'volume_name': 'volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e59b5c4-95b1-4fbf-8aa6-6e5a2e79236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e59b5c4-95b1-4fbf-8aa6-6e5a2e79236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae83aa3a-8678-44b3-8734-74ebe6d14fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:27 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Volume 1d97aa9a-805d-4cb2-b32f-98e1efd798a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0', 'volume_size': 1} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c60ad14e-4973-4a5a-9220-a4eff5ea3960,created_at=2026-09-11T21:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1680121601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c60ad14e-4973-4a5a-9220-a4eff5ea3960,host='devstack@QuobyteHD#QuobyteHD',id=1d97aa9a-805d-4cb2-b32f-98e1efd798a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd82c66ab0a4136b24660624fa22e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:27Z,use_quota=True,user_id='53b4dd7c2d194219b97c7cfb3d86c059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b560f04e-05fd-4575-947e-714c1fbc31fa),volume_type_id=b560f04e-05fd-4575-947e-714c1fbc31fa)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Creating volume 1d97aa9a-805d-4cb2-b32f-98e1efd798a0 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:27 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:27 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 1073741824 Sep 11 23:03:27 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "cinder-58815395-8a39-42e7-80d2-5e0c279aa73a-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Lock "cinder-58815395-8a39-42e7-80d2-5e0c279aa73a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "cinder-quobyte-58815395-8a39-42e7-80d2-5e0c279aa73a" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Lock "cinder-quobyte-58815395-8a39-42e7-80d2-5e0c279aa73a" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[318a2c77-569e-4174-a041-8c8a13d52a1e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:27 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a Sep 11 23:03:27 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:27 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 1073741824" returned: 0 in 0.553s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:27 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 Sep 11 23:03:27 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:27 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a" returned: 0 in 0.421s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:27 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a Sep 11 23:03:27 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:28 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae83aa3a-8678-44b3-8734-74ebe6d14fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:28 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547cdc87-a563-4286-953d-5520f8119438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58815395-8a39-42e7-80d2-5e0c279aa73a" returned: 0 in 0.254s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Lock "cinder-quobyte-58815395-8a39-42e7-80d2-5e0c279aa73a" released by "delete_volume" :: held 0.740s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:28 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Volume volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 (1d97aa9a-805d-4cb2-b32f-98e1efd798a0): created successfully Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547cdc87-a563-4286-953d-5520f8119438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Flow 'volume_create_manager' (123716af-825e-4151-b1b7-13d18e99f49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:28 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d4eb31d1-6514-4d14-a758-ca8043d5adc8 tempest-GroupSnapshotsTest-431167596 None] Created volume successfully. Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Created reservations ['1994ac2b-6ef8-48b3-a107-d0f5614e8ceb', '04e489e0-d739-4818-b0b5-027990b3ac35', '48539ca2-3c67-43df-999f-bbb498a6c573', '70024602-31e3-416d-9d45-a1fe53b1491e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:28 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:03:28 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "cinder-061d220e-1946-4d76-933d-941fc344f46b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Lock "cinder-061d220e-1946-4d76-933d-941fc344f46b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "cinder-quobyte-061d220e-1946-4d76-933d-941fc344f46b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:28 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] GroupSnapshot d0723fd0-cd88-47f2-ad67-3fc5d25a6c2a: creating. Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Lock "cinder-quobyte-061d220e-1946-4d76-933d-941fc344f46b" acquired by "delete_volume" :: waited 0.049s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:28 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.366s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:28 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Deleted volume successfully. Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Group snapshot d0723fd0-cd88-47f2-ad67-3fc5d25a6c2a: creating. {{(pid=88026) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[405da718-e68b-4dae-ad59-7e44d527120f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98cbf2f7-dac9-4d4c-bdc8-d1cd7d2b781b tempest-ServersNegativeTestJSON-404396112 None] Lock "cinder-58815395-8a39-42e7-80d2-5e0c279aa73a-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Creating offline snapshot 508ad15a-db0a-42e7-b109-1380c0795ba7 of volume 1d97aa9a-805d-4cb2-b32f-98e1efd798a0 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7221f9b2-64b7-48dc-a3c5-e2687038258b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:28 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b Sep 11 23:03:28 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:28 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 Sep 11 23:03:28 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:29 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b" returned: 0 in 0.375s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:29 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b Sep 11 23:03:29 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:29 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" returned: 0 in 0.394s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:29 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 1G Sep 11 23:03:29 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:29 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-061d220e-1946-4d76-933d-941fc344f46b" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Lock "cinder-quobyte-061d220e-1946-4d76-933d-941fc344f46b" released by "delete_volume" :: held 0.716s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Created reservations ['acf3df06-48f6-410c-b15a-a0612f740d97', '2c628593-6c38-47d4-a8eb-4fc4ef847113', '652c4552-1e6b-4b0b-8de4-1a65c9888ef9', '7b87afa8-cb18-4f39-b026-bc9f7f5f534b'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:29 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:03:29 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:29 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 1G" returned: 0 in 0.433s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:29 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 Sep 11 23:03:29 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:29 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Deleted volume successfully. Sep 11 23:03:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4fdb4baf-6491-44d2-8095-3bc225da9363 tempest-ServersNegativeTestJSON-404396112 None] Lock "cinder-061d220e-1946-4d76-933d-941fc344f46b-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:30 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7" returned: 0 in 0.406s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:30 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:03:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:30 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 Sep 11 23:03:30 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:30 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7" returned: 0 in 0.295s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:30 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.info Sep 11 23:03:30 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:30 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.info" returned: 0 in 0.391s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:30 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:03:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:30 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.info Sep 11 23:03:30 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:31 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.info" returned: 0 in 0.294s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:31 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-da9eccb5-b927-41eb-9f54-18c55dadedf6 tempest-GroupSnapshotsTest-431167596 None] group_snapshot d0723fd0-cd88-47f2-ad67-3fc5d25a6c2a: created successfully Sep 11 23:03:32 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] group_snapshot d0723fd0-cd88-47f2-ad67-3fc5d25a6c2a: deleting Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] group_snapshot d0723fd0-cd88-47f2-ad67-3fc5d25a6c2a: deleting {{(pid=88026) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-508ad15a-db0a-42e7-b109-1380c0795ba7" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-508ad15a-db0a-42e7-b109-1380c0795ba7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Deleting offline snapshot 508ad15a-db0a-42e7-b109-1380c0795ba7 of volume 1d97aa9a-805d-4cb2-b32f-98e1efd798a0 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] snapshot_file for this snap is: volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbde3b91-284f-489b-bad9-752ce125add1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:32 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 Sep 11 23:03:32 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Flow 'volume_create_manager' (f2357b8c-0a51-4e12-ab23-3bab882d3b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4a7d05-1e90-4709-8cf0-0e7926bfa425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4a7d05-1e90-4709-8cf0-0e7926bfa425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1075227379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb4b54e-dba2-423c-9595-74177f10e49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb2d7bd2f9b4746b2087ebc2d92d708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:33Z,use_quota=True,user_id='190b0ba1743141ec9346b7661734422a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d19b312-d653-4f8a-aaf5-308e956bdc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d19b312-d653-4f8a-aaf5-308e956bdc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1ac297-4ff7-4f31-9a96-6dd2b98f562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1ac297-4ff7-4f31-9a96-6dd2b98f562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb4b54e-dba2-423c-9595-74177f10e49d', 'volume_name': 'volume-1eb4b54e-dba2-423c-9595-74177f10e49d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131e95e9-de39-4a22-be28-9f26bc006bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131e95e9-de39-4a22-be28-9f26bc006bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12d9549-c207-4d24-8e32-770e82719a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:32 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Volume 1eb4b54e-dba2-423c-9595-74177f10e49d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb4b54e-dba2-423c-9595-74177f10e49d', 'volume_size': 1} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1075227379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb4b54e-dba2-423c-9595-74177f10e49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb2d7bd2f9b4746b2087ebc2d92d708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:33Z,use_quota=True,user_id='190b0ba1743141ec9346b7661734422a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Creating volume 1eb4b54e-dba2-423c-9595-74177f10e49d {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:32 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:32 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7" returned: 0 in 0.528s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:03:32 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d 1073741824 Sep 11 23:03:32 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[71364fc7-bc15-42cf-bbb8-23940929494d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:33 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 Sep 11 23:03:33 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:33 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d 1073741824" returned: 0 in 0.482s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:33 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" returned: 0 in 0.449s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:33 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 Sep 11 23:03:33 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:33 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d Sep 11 23:03:33 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:33 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d" returned: 0 in 0.412s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12d9549-c207-4d24-8e32-770e82719a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb4b54e-dba2-423c-9595-74177f10e49d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f690379e-fe14-4a3a-be8b-0f3e527fc475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:33 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Volume volume-1eb4b54e-dba2-423c-9595-74177f10e49d (1eb4b54e-dba2-423c-9595-74177f10e49d): created successfully Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f690379e-fe14-4a3a-be8b-0f3e527fc475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Flow 'volume_create_manager' (f2357b8c-0a51-4e12-ab23-3bab882d3b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ab99141b-1148-4b88-9fa5-31acffde80dc tempest-AttachVolumeShelveTestJSON-340910084 None] Created volume successfully. Sep 11 23:03:33 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7" returned: 0 in 0.559s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:33 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7 Sep 11 23:03:33 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:34 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0.508ad15a-db0a-42e7-b109-1380c0795ba7" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-508ad15a-db0a-42e7-b109-1380c0795ba7" released by "_delete_snapshot" :: held 1.947s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" released by "delete_snapshot" :: held 1.984s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:34 devstack cinder-volume[88026]: WARNING cinder.quota [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1982185260 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1982185260, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:34 devstack cinder-volume[88026]: WARNING cinder.quota [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1982185260 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1982185260, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:34 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] Created reservations ['37edb1a6-6c87-4e18-90ae-73e357ca091e', '369f2412-c9d6-4dd5-935f-f5079c755df9', '7fc89ad3-cff1-47e2-869d-39fffffc887c', '0603c890-dfc8-4434-83ed-9e5ed3290706'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8e6a6649-f9fa-4e1b-afe7-4ac1dc4728fe tempest-GroupSnapshotsTest-431167596 None] group_snapshot d0723fd0-cd88-47f2-ad67-3fc5d25a6c2a: deleted successfully Sep 11 23:03:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "cinder-quobyte-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a4a809-f5b2-4b5c-aa17-e2ce6a843e85]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:35 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 Sep 11 23:03:35 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:35 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" returned: 0 in 0.478s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:35 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0 Sep 11 23:03:35 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:35 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-e7296249-91c9-43f1-8e65-8f9920f72f53 req-dfb0f98b-7169-499e-8551-9b67e8a351d1 tempest-ServerActionsTestOtherA-877327324 None] Terminate volume connection completed successfully. Sep 11 23:03:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-e7296249-91c9-43f1-8e65-8f9920f72f53 req-dfb0f98b-7169-499e-8551-9b67e8a351d1 tempest-ServerActionsTestOtherA-877327324 None] Deleting attachment 6de4816b-202a-4ac1-9930-98368999c86e. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:03:36 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" returned: 0 in 0.371s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Lock "cinder-quobyte-1d97aa9a-805d-4cb2-b32f-98e1efd798a0" released by "delete_volume" :: held 0.952s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['6dc91bc2-ff75-49b3-8533-487a79a16e13'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:36 devstack cinder-volume[88026]: WARNING cinder.quota [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1982185260 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1982185260, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Created reservations ['9a5f8216-9dba-42c3-bc23-ed00be095f51', 'add45e0e-6e97-4331-a6dd-d11f1beb952f', 'b100e9c6-1ac4-4c3d-ac12-24df61c00cfb', 'cba2a684-e7e6-413e-b142-7ed9f22fc99e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:36 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:03:36 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:36 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.285s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:36 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:36 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-99026228-7b15-4594-9a34-22177c9ba1f1 tempest-GroupSnapshotsTest-431167596 None] Delete group completed successfully. Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=128,cinder:INSERT=26,cinder:UPDATE=118,cinder:DELETE=3 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Flow 'volume_create_manager' (2d6d7351-c760-4eac-a568-fbeb0502822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59f61a0-c16a-4ddf-9340-764f6cc940b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59f61a0-c16a-4ddf-9340-764f6cc940b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-268998757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b9d7a9-8c6d-4584-a391-11e0c15d3801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e19dd6452094f76a2be52cead8f2bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:45Z,use_quota=True,user_id='56de0794004b4794bfa9ab314675bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945dda9f-f484-43de-a40d-7d502b771796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945dda9f-f484-43de-a40d-7d502b771796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0359ea-35ac-46e6-bf79-737e5e445683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:45 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:03:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-623dd42d-1487-4d7e-9a6b-9e1360e7bccf tempest-GroupSnapshotsV319Test-1966926156 None] Group tempest-GroupSnapshotsV319Test-Group-499877234: creating Sep 11 23:03:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-623dd42d-1487-4d7e-9a6b-9e1360e7bccf tempest-GroupSnapshotsV319Test-1966926156 None] Group tempest-GroupSnapshotsV319Test-Group-499877234: created successfully Sep 11 23:03:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-623dd42d-1487-4d7e-9a6b-9e1360e7bccf tempest-GroupSnapshotsV319Test-1966926156 None] Create group completed successfully. Sep 11 23:03:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0359ea-35ac-46e6-bf79-737e5e445683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '28b9d7a9-8c6d-4584-a391-11e0c15d3801', 'volume_name': 'volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a32fd4-7328-45e5-8e45-d9d09ec9ae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a32fd4-7328-45e5-8e45-d9d09ec9ae75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8108fa38-dc0f-4f5d-b692-b763b96e01bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:46 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Volume 28b9d7a9-8c6d-4584-a391-11e0c15d3801: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:03:46 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Trying to clone 28b9d7a9-8c6d-4584-a391-11e0c15d3801 from image 30dc07db-5049-43e5-a274-fa94fe6ac71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:03:46 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:03:46 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:03:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[88925e55-52ea-416e-b051-dd928f52bcc7]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:46 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD Sep 11 23:03:46 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:47 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d is fetched for user 56de0794004b4794bfa9ab314675bb74. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a82c23-1034-4a3f-9c2a-9ebdc04c4ad1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-2b20afe2-4829-42ab-b498-3d1b66b77d7f req-bab4d90f-6490-4f6f-84c1-203a5b322cca tempest-AttachVolumeShelveTestJSON-340910084 None] No connector for attachment ef8adfb9-60a7-4e35-8103-73d720071d04; skipping storage backend terminate_connection call. {{(pid=88026) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-2b20afe2-4829-42ab-b498-3d1b66b77d7f req-bab4d90f-6490-4f6f-84c1-203a5b322cca tempest-AttachVolumeShelveTestJSON-340910084 None] Deleting attachment ef8adfb9-60a7-4e35-8103-73d720071d04. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:03:47 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD Sep 11 23:03:47 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Flow 'volume_create_manager' (3bee3e31-5156-458c-b9c8-38d08603e958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d35ba70-232d-4d37-a53f-978195b32d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:47 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d35ba70-232d-4d37-a53f-978195b32d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1083767473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbe151d1-f676-464a-bdf4-91fddaa0f55e,host='devstack@QuobyteHD#QuobyteHD',id=7e360712-8355-42f5-8d51-5918e84d336b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5406821b0a43e58c042b18b9b90c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:48Z,use_quota=True,user_id='f04f5aeba93942539521023eed8fe7af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4baa8244-c62c-41fc-a3cf-2fd7541076ac),volume_type_id=4baa8244-c62c-41fc-a3cf-2fd7541076ac)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e123d7a1-1b89-42d1-8b19-e56f5e691516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e123d7a1-1b89-42d1-8b19-e56f5e691516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85139d1f-9a70-4555-b986-32f76c518fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85139d1f-9a70-4555-b986-32f76c518fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e360712-8355-42f5-8d51-5918e84d336b', 'volume_name': 'volume-7e360712-8355-42f5-8d51-5918e84d336b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50d550d-df21-4632-8780-69f232dfd8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50d550d-df21-4632-8780-69f232dfd8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb59451e-403c-43d7-8ab0-370b865ff8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:47 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Volume 7e360712-8355-42f5-8d51-5918e84d336b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e360712-8355-42f5-8d51-5918e84d336b', 'volume_size': 1} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbe151d1-f676-464a-bdf4-91fddaa0f55e,created_at=2026-09-11T21:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1083767473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbe151d1-f676-464a-bdf4-91fddaa0f55e,host='devstack@QuobyteHD#QuobyteHD',id=7e360712-8355-42f5-8d51-5918e84d336b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5406821b0a43e58c042b18b9b90c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:48Z,use_quota=True,user_id='f04f5aeba93942539521023eed8fe7af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4baa8244-c62c-41fc-a3cf-2fd7541076ac),volume_type_id=4baa8244-c62c-41fc-a3cf-2fd7541076ac)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Creating volume 7e360712-8355-42f5-8d51-5918e84d336b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:47 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:47 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b 1073741824 Sep 11 23:03:47 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:48 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b 1073741824" returned: 0 in 0.728s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:48 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b Sep 11 23:03:48 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:48 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b" returned: 0 in 0.320s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.089s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-268998757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b9d7a9-8c6d-4584-a391-11e0c15d3801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e19dd6452094f76a2be52cead8f2bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:45Z,use_quota=True,user_id='56de0794004b4794bfa9ab314675bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Creating volume 28b9d7a9-8c6d-4584-a391-11e0c15d3801 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:03:49 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:49 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 1073741824 Sep 11 23:03:49 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb59451e-403c-43d7-8ab0-370b865ff8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e360712-8355-42f5-8d51-5918e84d336b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a3f68f-39a4-4153-9bad-f70184f83be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Volume volume-7e360712-8355-42f5-8d51-5918e84d336b (7e360712-8355-42f5-8d51-5918e84d336b): created successfully Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a3f68f-39a4-4153-9bad-f70184f83be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Flow 'volume_create_manager' (3bee3e31-5156-458c-b9c8-38d08603e958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-fe04d052-875f-4e82-bccb-ca9c68373a36 tempest-GroupSnapshotsV319Test-1966926156 None] Created volume successfully. Sep 11 23:03:49 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 1073741824" returned: 0 in 0.526s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:49 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 Sep 11 23:03:49 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:49 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801" returned: 0 in 0.376s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:03:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Attempting download of 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 28b9d7a9-8c6d-4584-a391-11e0c15d3801. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c790b70c-9aa5-42f8-94b2-f10da52a6549]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_u403qcj7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:50 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_u403qcj7 Sep 11 23:03:50 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] GroupSnapshot 0096923b-1267-4415-9dfe-dcef3e3fdf5a: creating. Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Group snapshot 0096923b-1267-4415-9dfe-dcef3e3fdf5a: creating. {{(pid=88026) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:50 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_u403qcj7" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_u403qcj7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Creating offline snapshot eee34b2c-7f48-4c39-870f-6606fa0fd4d9 of volume 7e360712-8355-42f5-8d51-5918e84d336b {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf65c7f-73f7-492a-8e83-692305ee675a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:50 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b Sep 11 23:03:50 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:50 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_u403qcj7 Sep 11 23:03:50 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:51 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b" returned: 0 in 0.465s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:51 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 1G Sep 11 23:03:51 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:51 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_u403qcj7" returned: 1 in 0.608s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_u403qcj7' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb217d9-c9aa-4639-89c3-14a9c4a56a62]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:51 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD Sep 11 23:03:51 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:51 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:51 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 1G" returned: 0 in 0.550s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e360712-8355-42f5-8d51-5918e84d336b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] 30dc07db-5049-43e5-a274-fa94fe6ac71d was qcow2, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:03:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:51 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e360712-8355-42f5-8d51-5918e84d336b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 Sep 11 23:03:51 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:51 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 Sep 11 23:03:51 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:52 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e360712-8355-42f5-8d51-5918e84d336b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9" returned: 0 in 0.435s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:52 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:03:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:52 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 Sep 11 23:03:52 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:52 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9" returned: 0 in 0.371s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:52 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.info Sep 11 23:03:52 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:52 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.info" returned: 0 in 0.294s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:52 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:03:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:52 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.info Sep 11 23:03:52 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:53 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.info" returned: 0 in 0.440s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.687s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-79ee6c28-aa42-4cac-9181-2f27e6192a88 tempest-GroupSnapshotsV319Test-1966926156 None] group_snapshot 0096923b-1267-4415-9dfe-dcef3e3fdf5a: created successfully Sep 11 23:03:54 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801" returned: 0 in 2.570s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_5dwb3cbedevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:03:54 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Converted 112.00 MB image at 43.56 MB/s Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:54 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 1G Sep 11 23:03:54 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:54 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] group_snapshot 0096923b-1267-4415-9dfe-dcef3e3fdf5a: deleting Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] group_snapshot 0096923b-1267-4415-9dfe-dcef3e3fdf5a: deleting {{(pid=88026) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Acquiring lock "cinder-quobyte-7e360712-8355-42f5-8d51-5918e84d336b" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "cinder-quobyte-7e360712-8355-42f5-8d51-5918e84d336b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Acquiring lock "cinder-quobyte-eee34b2c-7f48-4c39-870f-6606fa0fd4d9" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "cinder-quobyte-eee34b2c-7f48-4c39-870f-6606fa0fd4d9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Deleting offline snapshot eee34b2c-7f48-4c39-870f-6606fa0fd4d9 of volume 7e360712-8355-42f5-8d51-5918e84d336b {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] snapshot_file for this snap is: volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46606cd-8adf-4465-b723-8469eeaf4a01]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:54 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 Sep 11 23:03:54 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:54 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 1G" returned: 0 in 0.660s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Downloaded image 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 28b9d7a9-8c6d-4584-a391-11e0c15d3801 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d for user 56de0794004b4794bfa9ab314675bb74 is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Marking volume 28b9d7a9-8c6d-4584-a391-11e0c15d3801 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Copying metadata from image 30dc07db-5049-43e5-a274-fa94fe6ac71d to 28b9d7a9-8c6d-4584-a391-11e0c15d3801. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:03:54 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Creating volume glance metadata for volume 28b9d7a9-8c6d-4584-a391-11e0c15d3801 backed by image 30dc07db-5049-43e5-a274-fa94fe6ac71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8108fa38-dc0f-4f5d-b692-b763b96e01bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cb1398-9962-441b-855e-6e35bd5e7ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:03:55 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9" returned: 0 in 0.573s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e360712-8355-42f5-8d51-5918e84d336b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:03:55 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Volume volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 (28b9d7a9-8c6d-4584-a391-11e0c15d3801): created successfully Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cb1398-9962-441b-855e-6e35bd5e7ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Flow 'volume_create_manager' (2d6d7351-c760-4eac-a568-fbeb0502822e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60331ea2-8eef-468c-817d-18d8a7c637df]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2071d794-7fbc-4a44-ba03-9d2b00343857 tempest-ServerActionsTestOtherA-877327324 None] Created volume successfully. Sep 11 23:03:55 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b Sep 11 23:03:55 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:55 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b" returned: 0 in 0.575s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:55 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 Sep 11 23:03:55 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:56 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9" returned: 0 in 0.456s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:56 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9 Sep 11 23:03:56 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:56 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b.eee34b2c-7f48-4c39-870f-6606fa0fd4d9" returned: 0 in 0.310s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "cinder-quobyte-eee34b2c-7f48-4c39-870f-6606fa0fd4d9" released by "_delete_snapshot" :: held 2.101s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Lock "cinder-quobyte-7e360712-8355-42f5-8d51-5918e84d336b" released by "delete_snapshot" :: held 2.138s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:56 devstack cinder-volume[88026]: WARNING cinder.quota [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2061475542 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2061475542, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:56 devstack cinder-volume[88026]: WARNING cinder.quota [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2061475542 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2061475542, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:56 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] Created reservations ['73866a8c-90f1-42a7-a7e9-c5b846637d93', 'c652345f-b1ed-4790-8f41-a0ff6e204923', '41ee6337-fc73-4eda-b879-6f0f2b6e6e2c', 'cd9553ca-e093-48a3-8d22-a552aa996333'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e7d815e6-608f-411c-9af7-661199a61cf4 tempest-GroupSnapshotsV319Test-1966926156 None] group_snapshot 0096923b-1267-4415-9dfe-dcef3e3fdf5a: deleted successfully Sep 11 23:03:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Acquiring lock "cinder-quobyte-7e360712-8355-42f5-8d51-5918e84d336b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:03:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Lock "cinder-quobyte-7e360712-8355-42f5-8d51-5918e84d336b" acquired by "delete_volume" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:03:57 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1724b670-2f19-4b5d-aaf3-851bce90d395]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:03:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:57 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b Sep 11 23:03:57 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:57 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b" returned: 0 in 0.469s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:57 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b Sep 11 23:03:57 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:58 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7e360712-8355-42f5-8d51-5918e84d336b" returned: 0 in 0.399s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Lock "cinder-quobyte-7e360712-8355-42f5-8d51-5918e84d336b" released by "delete_volume" :: held 0.990s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Created reservations ['ba472c21-7f51-4445-a57f-d57d15926569'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:58 devstack cinder-volume[88026]: WARNING cinder.quota [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2061475542 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2061475542, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Created reservations ['62120322-232e-4f77-9d5c-7a1e618b46ac', '36993210-5612-4262-bfac-089ebab1e73c', '170c9c7b-7a57-439c-b289-b5a9da735b34', '2fc1e52f-8a8a-4f07-bdb6-f973a963a047'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:03:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:03:58 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:03:58 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:03:59 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Sep 11 23:03:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.373s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:03:59 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:03:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-02d4f696-78db-4ddf-adaa-e3ef3628c7cf tempest-GroupSnapshotsV319Test-1966926156 None] Delete group completed successfully. Sep 11 23:04:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-ac4738bc-dec0-4e8c-9b8e-bfd25e5e5db7 req-4d516403-6004-4a8e-9c66-a5e5f25755d6 tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-ac4738bc-dec0-4e8c-9b8e-bfd25e5e5db7 req-4d516403-6004-4a8e-9c66-a5e5f25755d6 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-ac4738bc-dec0-4e8c-9b8e-bfd25e5e5db7 req-4d516403-6004-4a8e-9c66-a5e5f25755d6 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-ac4738bc-dec0-4e8c-9b8e-bfd25e5e5db7 req-4d516403-6004-4a8e-9c66-a5e5f25755d6 tempest-ServerActionsTestOtherA-877327324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a726eaeb-2c8b-409d-8976-496e64c0aa21', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:04:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-ac4738bc-dec0-4e8c-9b8e-bfd25e5e5db7 req-4d516403-6004-4a8e-9c66-a5e5f25755d6 tempest-ServerActionsTestOtherA-877327324 None] attachment_update completed successfully. Sep 11 23:04:10 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=103,cinder:INSERT=26,cinder:UPDATE=117,cinder:DELETE=4 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:04:10 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=43,cinder:UPDATE=22,cinder:INSERT=18,cinder:DELETE=2 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:11 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:04:11 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:11 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.490s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:04:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:04:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-826ba490-0ca7-4bbf-bd2e-39596b1128c4 req-013d8835-2f41-4a42-b4ee-26a6c71fba31 tempest-ServerActionsTestOtherA-877327324 None] Terminate volume connection completed successfully. Sep 11 23:04:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-826ba490-0ca7-4bbf-bd2e-39596b1128c4 req-013d8835-2f41-4a42-b4ee-26a6c71fba31 tempest-ServerActionsTestOtherA-877327324 None] Deleting attachment a726eaeb-2c8b-409d-8976-496e64c0aa21. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:04:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-826ba490-0ca7-4bbf-bd2e-39596b1128c4 req-20673601-7ffb-4613-9d08-345b5a8aafb4 tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-826ba490-0ca7-4bbf-bd2e-39596b1128c4 req-20673601-7ffb-4613-9d08-345b5a8aafb4 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-826ba490-0ca7-4bbf-bd2e-39596b1128c4 req-20673601-7ffb-4613-9d08-345b5a8aafb4 tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-826ba490-0ca7-4bbf-bd2e-39596b1128c4 req-20673601-7ffb-4613-9d08-345b5a8aafb4 tempest-ServerActionsTestOtherA-877327324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '708f0edb-247a-4e18-bc40-e93816b904ac', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:04:28 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1bc4a89b-4cba-4f03-807a-b1ff5806ec2e tempest-GroupsTest-954114113 None] Group tempest-Group1-820134235: creating Sep 11 23:04:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1bc4a89b-4cba-4f03-807a-b1ff5806ec2e tempest-GroupsTest-954114113 None] Group tempest-Group1-820134235: created successfully Sep 11 23:04:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1bc4a89b-4cba-4f03-807a-b1ff5806ec2e tempest-GroupsTest-954114113 None] Create group completed successfully. Sep 11 23:04:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-826ba490-0ca7-4bbf-bd2e-39596b1128c4 req-20673601-7ffb-4613-9d08-345b5a8aafb4 tempest-ServerActionsTestOtherA-877327324 None] attachment_update completed successfully. Sep 11 23:04:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f3c2870a-8eb7-4cce-8727-54593a88f74f tempest-GroupsTest-954114113 None] Group tempest-Group2-764724457: creating Sep 11 23:04:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f3c2870a-8eb7-4cce-8727-54593a88f74f tempest-GroupsTest-954114113 None] Group tempest-Group2-764724457: created successfully Sep 11 23:04:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f3c2870a-8eb7-4cce-8727-54593a88f74f tempest-GroupsTest-954114113 None] Create group completed successfully. Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Flow 'volume_create_manager' (632d7156-e685-406a-8884-e927a4cab277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c12ddfd-5ebd-4812-a9cf-d7577714c503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c12ddfd-5ebd-4812-a9cf-d7577714c503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-57895172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e74955e5-02b1-4eb0-8167-2554ff10201b,host='devstack@QuobyteHD#QuobyteHD',id=48978ba7-1eaa-4934-9a62-4cf2f187829b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467635e82a864f90b311b3ac7c6e52bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:33Z,use_quota=True,user_id='fce7b8b040cc45b6bd98f9946c740559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bf4c72c-60fd-4a07-8c1a-d94ad3166c3b),volume_type_id=8bf4c72c-60fd-4a07-8c1a-d94ad3166c3b)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adc36ba-f851-4f5a-ba45-1013cde579d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adc36ba-f851-4f5a-ba45-1013cde579d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f468bf-7d73-470c-a03a-eec0b71b5e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f468bf-7d73-470c-a03a-eec0b71b5e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48978ba7-1eaa-4934-9a62-4cf2f187829b', 'volume_name': 'volume-48978ba7-1eaa-4934-9a62-4cf2f187829b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56435d2e-dfc8-4c42-8e04-fa97d065fe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56435d2e-dfc8-4c42-8e04-fa97d065fe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6cf0db-da5b-4417-a08b-e5957b19b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:32 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Volume 48978ba7-1eaa-4934-9a62-4cf2f187829b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48978ba7-1eaa-4934-9a62-4cf2f187829b', 'volume_size': 1} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e74955e5-02b1-4eb0-8167-2554ff10201b,created_at=2026-09-11T21:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-57895172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e74955e5-02b1-4eb0-8167-2554ff10201b,host='devstack@QuobyteHD#QuobyteHD',id=48978ba7-1eaa-4934-9a62-4cf2f187829b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467635e82a864f90b311b3ac7c6e52bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:33Z,use_quota=True,user_id='fce7b8b040cc45b6bd98f9946c740559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bf4c72c-60fd-4a07-8c1a-d94ad3166c3b),volume_type_id=8bf4c72c-60fd-4a07-8c1a-d94ad3166c3b)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Creating volume 48978ba7-1eaa-4934-9a62-4cf2f187829b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:04:32 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:04:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:33 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b 1073741824 Sep 11 23:04:33 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:33 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Acquiring lock "cinder-1eb4b54e-dba2-423c-9595-74177f10e49d-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b 1073741824" returned: 0 in 0.613s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "cinder-1eb4b54e-dba2-423c-9595-74177f10e49d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:33 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b Sep 11 23:04:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Acquiring lock "cinder-quobyte-1eb4b54e-dba2-423c-9595-74177f10e49d" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:33 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "cinder-quobyte-1eb4b54e-dba2-423c-9595-74177f10e49d" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:33 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8956e1-dd83-42f0-a60c-c3166c681b9b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:33 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d Sep 11 23:04:33 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:34 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b" returned: 0 in 0.542s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6cf0db-da5b-4417-a08b-e5957b19b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48978ba7-1eaa-4934-9a62-4cf2f187829b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9672737-dc16-48bb-80d9-ff359b1f48ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Volume volume-48978ba7-1eaa-4934-9a62-4cf2f187829b (48978ba7-1eaa-4934-9a62-4cf2f187829b): created successfully Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9672737-dc16-48bb-80d9-ff359b1f48ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Flow 'volume_create_manager' (632d7156-e685-406a-8884-e927a4cab277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e4dfb2ec-1e62-4d19-abeb-59eb1886e287 tempest-GroupsTest-954114113 None] Created volume successfully. Sep 11 23:04:34 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d" returned: 0 in 0.728s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:34 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d Sep 11 23:04:34 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:34 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1eb4b54e-dba2-423c-9595-74177f10e49d" returned: 0 in 0.334s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "cinder-quobyte-1eb4b54e-dba2-423c-9595-74177f10e49d" released by "delete_volume" :: held 1.112s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Created reservations ['d0d88c23-a05f-4feb-a984-045d7e6d36b5', 'd854567d-e11d-4808-a7f0-4e80dbeff218', '62c9732e-18b8-4b04-b77f-6d2dfa546124', 'a6cf593b-011a-4273-b20e-8ee86cef5bbb'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:35 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:04:35 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:35 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.280s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:35 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:35 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Deleted volume successfully. Sep 11 23:04:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-32ac5cfa-3f63-4bca-8dce-6b4af1307994 tempest-AttachVolumeShelveTestJSON-340910084 None] Lock "cinder-1eb4b54e-dba2-423c-9595-74177f10e49d-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Acquiring lock "cinder-quobyte-48978ba7-1eaa-4934-9a62-4cf2f187829b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Lock "cinder-quobyte-48978ba7-1eaa-4934-9a62-4cf2f187829b" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:36 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f24515e-ef2d-4fa8-89f6-84922d97f899]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:36 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b Sep 11 23:04:36 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:37 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b" returned: 0 in 0.519s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:37 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b Sep 11 23:04:37 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:37 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-48978ba7-1eaa-4934-9a62-4cf2f187829b" returned: 0 in 0.352s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Lock "cinder-quobyte-48978ba7-1eaa-4934-9a62-4cf2f187829b" released by "delete_volume" :: held 0.937s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Created reservations ['d106fb4a-3795-45d0-862d-909aff7ba26e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:37 devstack cinder-volume[88026]: WARNING cinder.quota [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-160617035 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-160617035, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:04:37 devstack cinder-volume[88026]: WARNING cinder.quota [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-160617035 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-160617035, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Created reservations ['0811d845-2121-4148-8d26-85c984750e77', '3ce4f781-8ed0-4cd3-b59a-3e40414a15a8', '7bce3786-bc88-4941-843d-87cca6536b4d', '601dadd6-a7b2-4af3-9160-f54395a5a107'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:37 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:04:37 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:38 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.325s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:38 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:38 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1908d167-daa3-40cf-824f-4442f43bd859 tempest-GroupsTest-954114113 None] Delete group completed successfully. Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Created reservations ['a362345a-6dd6-4088-848b-099e480e248b'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:39 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:04:39 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:39 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.336s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:39 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:39 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ed2e2712-a72e-488e-944a-e39353abd905 tempest-GroupsTest-954114113 None] Delete group completed successfully. Sep 11 23:04:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2a2090f0-eeaa-4340-941c-3db33cbb969a tempest-GroupsTest-954114113 None] Group tempest-GroupsTest-Group-1891783688: creating Sep 11 23:04:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2a2090f0-eeaa-4340-941c-3db33cbb969a tempest-GroupsTest-954114113 None] Group tempest-GroupsTest-Group-1891783688: created successfully Sep 11 23:04:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2a2090f0-eeaa-4340-941c-3db33cbb969a tempest-GroupsTest-954114113 None] Create group completed successfully. Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Flow 'volume_create_manager' (1829be7f-813b-4ee9-93af-c6be205f8720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ac7318-6c35-40d1-b51d-d786ab5bce90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ac7318-6c35-40d1-b51d-d786ab5bce90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1553822415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f392ec10-bc57-4096-9d81-a62c8880457f,host='devstack@QuobyteHD#QuobyteHD',id=3f3b001c-f85f-4013-b07f-af3076d8236f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467635e82a864f90b311b3ac7c6e52bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:43Z,use_quota=True,user_id='fce7b8b040cc45b6bd98f9946c740559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f8e772-5b39-4a9f-bd78-cbfa886acd12),volume_type_id=74f8e772-5b39-4a9f-bd78-cbfa886acd12)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a2468e-5131-4f90-9188-3f923d6b4f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a2468e-5131-4f90-9188-3f923d6b4f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cef7c39-49ca-4c78-a2b6-fe3951402735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cef7c39-49ca-4c78-a2b6-fe3951402735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f3b001c-f85f-4013-b07f-af3076d8236f', 'volume_name': 'volume-3f3b001c-f85f-4013-b07f-af3076d8236f', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f967d727-4608-4138-b475-3161551e5c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f967d727-4608-4138-b475-3161551e5c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c452d5-58e9-46da-b9dd-a96bda09ad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Volume 3f3b001c-f85f-4013-b07f-af3076d8236f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f3b001c-f85f-4013-b07f-af3076d8236f', 'volume_size': 1} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f392ec10-bc57-4096-9d81-a62c8880457f,created_at=2026-09-11T21:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1553822415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f392ec10-bc57-4096-9d81-a62c8880457f,host='devstack@QuobyteHD#QuobyteHD',id=3f3b001c-f85f-4013-b07f-af3076d8236f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467635e82a864f90b311b3ac7c6e52bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:43Z,use_quota=True,user_id='fce7b8b040cc45b6bd98f9946c740559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f8e772-5b39-4a9f-bd78-cbfa886acd12),volume_type_id=74f8e772-5b39-4a9f-bd78-cbfa886acd12)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Creating volume 3f3b001c-f85f-4013-b07f-af3076d8236f {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:04:42 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:04:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:42 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f 1073741824 Sep 11 23:04:42 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:43 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f 1073741824" returned: 0 in 0.687s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:43 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f Sep 11 23:04:43 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Flow 'volume_create_manager' (6fcdc7ee-a3bc-44ca-b7ad-b277073ae4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a3d0a2-5c7f-4b82-acbb-e2bd148b0377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a3d0a2-5c7f-4b82-acbb-e2bd148b0377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-749163197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085c5cf0-2ba8-488e-9e5e-a68497eead19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e4c26d1774effa5fe230487218fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:44Z,use_quota=True,user_id='249f71cf4e4c43af85b54007c30a2fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2811d6-8a3c-4186-b585-4247fd485ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2811d6-8a3c-4186-b585-4247fd485ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c27d710-9ac5-4735-9965-b7506b47460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c27d710-9ac5-4735-9965-b7506b47460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085c5cf0-2ba8-488e-9e5e-a68497eead19', 'volume_name': 'volume-085c5cf0-2ba8-488e-9e5e-a68497eead19', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c240a5-5455-4d50-9627-1c163a40aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c240a5-5455-4d50-9627-1c163a40aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ebe230-565f-4f76-b48e-f8ce5781816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Volume 085c5cf0-2ba8-488e-9e5e-a68497eead19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085c5cf0-2ba8-488e-9e5e-a68497eead19', 'volume_size': 1} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:44 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f" returned: 0 in 0.402s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-749163197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085c5cf0-2ba8-488e-9e5e-a68497eead19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e4c26d1774effa5fe230487218fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:44Z,use_quota=True,user_id='249f71cf4e4c43af85b54007c30a2fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Creating volume 085c5cf0-2ba8-488e-9e5e-a68497eead19 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:04:44 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:44 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 1073741824 Sep 11 23:04:44 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c452d5-58e9-46da-b9dd-a96bda09ad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3b001c-f85f-4013-b07f-af3076d8236f', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c465184-f54e-4736-ac78-fae77b39dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Volume volume-3f3b001c-f85f-4013-b07f-af3076d8236f (3f3b001c-f85f-4013-b07f-af3076d8236f): created successfully Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c465184-f54e-4736-ac78-fae77b39dde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Flow 'volume_create_manager' (1829be7f-813b-4ee9-93af-c6be205f8720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c84f4f46-2426-48cb-826e-0dd3cb425af2 tempest-GroupsTest-954114113 None] Created volume successfully. Sep 11 23:04:44 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 1073741824" returned: 0 in 0.543s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:44 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 Sep 11 23:04:44 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:45 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19" returned: 0 in 0.310s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ebe230-565f-4f76-b48e-f8ce5781816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085c5cf0-2ba8-488e-9e5e-a68497eead19', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0945278f-0368-456f-8aaf-c161e0bc7e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Volume volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 (085c5cf0-2ba8-488e-9e5e-a68497eead19): created successfully Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0945278f-0368-456f-8aaf-c161e0bc7e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Flow 'volume_create_manager' (6fcdc7ee-a3bc-44ca-b7ad-b277073ae4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0250d2ae-4a4e-4016-a490-6cacd58aa348 tempest-AttachVolumeTestJSON-1441574395 None] Created volume successfully. Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-37ec570e-52b0-4572-9b2a-a71f38923a06 tempest-BackendsCapabilitiesAdminTestsJSON-1377407960 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88026) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 23:04:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-07fdb6fa-1438-4678-ae1e-dd27e369eaef tempest-BackendsCapabilitiesAdminTestsJSON-1377407960 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88026) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Flow 'volume_create_manager' (2bf096d1-1bb9-429a-bb40-77d19cd63de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15afe15b-6e47-4561-a8ac-0bf43853774c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15afe15b-6e47-4561-a8ac-0bf43853774c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1320505986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f392ec10-bc57-4096-9d81-a62c8880457f,host='devstack@QuobyteHD#QuobyteHD',id=68c2c0a3-0da9-44b8-97c5-f106d5954b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467635e82a864f90b311b3ac7c6e52bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:46Z,use_quota=True,user_id='fce7b8b040cc45b6bd98f9946c740559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f8e772-5b39-4a9f-bd78-cbfa886acd12),volume_type_id=74f8e772-5b39-4a9f-bd78-cbfa886acd12)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1a1ad2-cd6d-4521-99a9-8a9ca4f52671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1a1ad2-cd6d-4521-99a9-8a9ca4f52671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7970b5a3-2569-4f60-80dd-b9a5b16e0416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7970b5a3-2569-4f60-80dd-b9a5b16e0416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c2c0a3-0da9-44b8-97c5-f106d5954b60', 'volume_name': 'volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ef50ce-84ad-45bc-990b-9698aba43518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ef50ce-84ad-45bc-990b-9698aba43518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e054eeb1-6089-4608-b5da-953ff5dfd6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:46 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Volume 68c2c0a3-0da9-44b8-97c5-f106d5954b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60', 'volume_size': 1} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f392ec10-bc57-4096-9d81-a62c8880457f,created_at=2026-09-11T21:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1320505986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f392ec10-bc57-4096-9d81-a62c8880457f,host='devstack@QuobyteHD#QuobyteHD',id=68c2c0a3-0da9-44b8-97c5-f106d5954b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='467635e82a864f90b311b3ac7c6e52bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:46Z,use_quota=True,user_id='fce7b8b040cc45b6bd98f9946c740559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f8e772-5b39-4a9f-bd78-cbfa886acd12),volume_type_id=74f8e772-5b39-4a9f-bd78-cbfa886acd12)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Creating volume 68c2c0a3-0da9-44b8-97c5-f106d5954b60 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:04:46 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:46 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 1073741824 Sep 11 23:04:46 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-4f8a032d-9de3-4814-a5d2-9cb56ab8f332 req-48c5e89c-e752-4d1c-b2a8-3fdb59e5b69a tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:47 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 1073741824" returned: 0 in 0.600s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:47 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 Sep 11 23:04:47 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:47 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60" returned: 0 in 0.324s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-4f8a032d-9de3-4814-a5d2-9cb56ab8f332 req-48c5e89c-e752-4d1c-b2a8-3fdb59e5b69a tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.459s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e054eeb1-6089-4608-b5da-953ff5dfd6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0160badc-7ae0-4fe0-9fef-15a9973a5676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-4f8a032d-9de3-4814-a5d2-9cb56ab8f332 req-48c5e89c-e752-4d1c-b2a8-3fdb59e5b69a tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.076s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:47 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Volume volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 (68c2c0a3-0da9-44b8-97c5-f106d5954b60): created successfully Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0160badc-7ae0-4fe0-9fef-15a9973a5676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Flow 'volume_create_manager' (2bf096d1-1bb9-429a-bb40-77d19cd63de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:04:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-16c8f2e8-b79d-4d53-9dff-ce06f80e0940 tempest-GroupsTest-954114113 None] Created volume successfully. Sep 11 23:04:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-4f8a032d-9de3-4814-a5d2-9cb56ab8f332 req-48c5e89c-e752-4d1c-b2a8-3fdb59e5b69a tempest-AttachVolumeTestJSON-1441574395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-085c5cf0-2ba8-488e-9e5e-a68497eead19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b1c0f8e-c744-45c3-8843-79277eef2c09', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:04:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-4f8a032d-9de3-4814-a5d2-9cb56ab8f332 req-48c5e89c-e752-4d1c-b2a8-3fdb59e5b69a tempest-AttachVolumeTestJSON-1441574395 None] attachment_update completed successfully. Sep 11 23:04:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-792b798b-af8c-472b-ac96-f155e5b62026 tempest-GroupsTest-954114113 None] Update group completed successfully. Sep 11 23:04:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-daf16635-5c74-4432-8fc4-21ce51c10989 tempest-GroupsTest-954114113 None] Update group completed successfully. Sep 11 23:04:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Acquiring lock "cinder-quobyte-3f3b001c-f85f-4013-b07f-af3076d8236f" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Lock "cinder-quobyte-3f3b001c-f85f-4013-b07f-af3076d8236f" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c906f44-3c57-4328-ad24-58462df35317]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:52 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f Sep 11 23:04:52 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:53 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f" returned: 0 in 0.666s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:53 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f Sep 11 23:04:53 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:53 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f3b001c-f85f-4013-b07f-af3076d8236f" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-70f69bc6-78e0-4eab-905b-f9bf0a662e17 tempest-GroupsV320Test-1626042316 None] Group tempest-GroupsV320Test-Group-1164361533: creating Sep 11 23:04:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Lock "cinder-quobyte-3f3b001c-f85f-4013-b07f-af3076d8236f" released by "delete_volume" :: held 1.145s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Acquiring lock "cinder-quobyte-68c2c0a3-0da9-44b8-97c5-f106d5954b60" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:04:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Lock "cinder-quobyte-68c2c0a3-0da9-44b8-97c5-f106d5954b60" acquired by "delete_volume" :: waited 0.049s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:04:53 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a8443f-0e8f-445a-b648-fc75c3a91199]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:04:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-70f69bc6-78e0-4eab-905b-f9bf0a662e17 tempest-GroupsV320Test-1626042316 None] Group tempest-GroupsV320Test-Group-1164361533: created successfully Sep 11 23:04:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-70f69bc6-78e0-4eab-905b-f9bf0a662e17 tempest-GroupsV320Test-1626042316 None] Create group completed successfully. Sep 11 23:04:53 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 Sep 11 23:04:53 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:54 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60" returned: 0 in 0.628s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:54 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60 Sep 11 23:04:54 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:54 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-68c2c0a3-0da9-44b8-97c5-f106d5954b60" returned: 0 in 0.384s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Lock "cinder-quobyte-68c2c0a3-0da9-44b8-97c5-f106d5954b60" released by "delete_volume" :: held 1.092s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:04:54 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Created reservations ['839b18b8-84ac-47f9-8a57-af4a756697a8'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:54 devstack cinder-volume[88026]: WARNING cinder.quota [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-126693957 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-126693957, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:04:54 devstack cinder-volume[88026]: WARNING cinder.quota [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-126693957 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-126693957, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:04:54 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Created reservations ['f03d66d3-ce5e-41fd-8dc3-cec1a9608faa', 'ebcf254e-126c-4109-bd15-08a4c3213d58', '05a61e12-68b2-46b8-92e3-5178f732f40d', 'dda8391e-7d5e-4556-b634-7074aaba87fe'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Created reservations ['17b5c4c2-64d6-4b1d-b2e2-38e325eeee2c', 'd2980e35-cc0c-40c8-84b9-2a7e8c5f11f9', '77b3fe08-e5ac-44be-84c7-df5516647424', '8a916641-05cf-49e2-ac52-35e01b3a2589'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:55 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:04:55 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Created reservations ['af0ea292-ebb1-4f6c-b1aa-0fb0671a1222'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:04:55 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:04:55 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:04:55 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.344s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6b4a4bf2-f216-49bf-9974-1b3cf378a55d tempest-GroupsTest-954114113 None] Delete group completed successfully. Sep 11 23:04:55 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.321s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:04:55 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:04:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4e29da00-0b90-4fb4-ab69-cb779659909c tempest-GroupsV320Test-1626042316 None] Delete group completed successfully. Sep 11 23:05:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-40c6fbe9-b59a-4ce5-af6e-990c27d35ed2 tempest-GroupsV314Test-1841191049 None] Group tempest-GroupsV314Test-Group-16907670: creating Sep 11 23:05:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-40c6fbe9-b59a-4ce5-af6e-990c27d35ed2 tempest-GroupsV314Test-1841191049 None] Group tempest-GroupsV314Test-Group-16907670: created successfully Sep 11 23:05:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-40c6fbe9-b59a-4ce5-af6e-990c27d35ed2 tempest-GroupsV314Test-1841191049 None] Create group completed successfully. Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Flow 'volume_create_manager' (0031f490-900d-4331-bed7-8f07b2546520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ab7e4b-7b0f-4808-b30c-afb4336b48ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ab7e4b-7b0f-4808-b30c-afb4336b48ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-699708595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c19c4af-0aa3-4473-bd68-a77de15eac9b,host='devstack@QuobyteHD#QuobyteHD',id=2d1cef5c-6455-474d-823d-bc365f4abd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fe9c3e10f64530897aaabf7dcc5f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:06Z,use_quota=True,user_id='e72b555c7869411987b8b1758bdf149e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(618f161b-2e4e-4e6b-85fd-a9e41d8e590a),volume_type_id=618f161b-2e4e-4e6b-85fd-a9e41d8e590a)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c774b143-3f8f-4d8f-88de-eb8790140f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c774b143-3f8f-4d8f-88de-eb8790140f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d97a1a-b5aa-4684-b2ef-8882b9b36418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d97a1a-b5aa-4684-b2ef-8882b9b36418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d1cef5c-6455-474d-823d-bc365f4abd8c', 'volume_name': 'volume-2d1cef5c-6455-474d-823d-bc365f4abd8c', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c9ccdb-3b36-43d1-8dfe-239c2bfcdac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c9ccdb-3b36-43d1-8dfe-239c2bfcdac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716bef96-93b5-4e81-a7f5-5015ff42b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:06 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Volume 2d1cef5c-6455-474d-823d-bc365f4abd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d1cef5c-6455-474d-823d-bc365f4abd8c', 'volume_size': 1} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c19c4af-0aa3-4473-bd68-a77de15eac9b,created_at=2026-09-11T21:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-699708595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c19c4af-0aa3-4473-bd68-a77de15eac9b,host='devstack@QuobyteHD#QuobyteHD',id=2d1cef5c-6455-474d-823d-bc365f4abd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fe9c3e10f64530897aaabf7dcc5f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:06Z,use_quota=True,user_id='e72b555c7869411987b8b1758bdf149e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(618f161b-2e4e-4e6b-85fd-a9e41d8e590a),volume_type_id=618f161b-2e4e-4e6b-85fd-a9e41d8e590a)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Creating volume 2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:06 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:06 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c 1073741824 Sep 11 23:05:06 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:06 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c 1073741824" returned: 0 in 0.465s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:06 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c Sep 11 23:05:06 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:07 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c" returned: 0 in 0.280s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716bef96-93b5-4e81-a7f5-5015ff42b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1cef5c-6455-474d-823d-bc365f4abd8c', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135e2396-c9fa-40d0-aabb-bd5dcd96c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:07 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Volume volume-2d1cef5c-6455-474d-823d-bc365f4abd8c (2d1cef5c-6455-474d-823d-bc365f4abd8c): created successfully Sep 11 23:05:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135e2396-c9fa-40d0-aabb-bd5dcd96c70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Flow 'volume_create_manager' (0031f490-900d-4331-bed7-8f07b2546520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:07 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e5c24f96-8b06-4493-b707-4dff5e9a00c7 tempest-GroupsV314Test-1841191049 None] Created volume successfully. Sep 11 23:05:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:08 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Cloning volume 2d1cef5c-6455-474d-823d-bc365f4abd8c to volume f2de1614-3fb0-4195-8fef-68d789ac2cca Sep 11 23:05:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Creating offline snapshot 41fa4756-eff6-4210-a644-c39a1b744741 of volume 2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:05:08 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b5f701-c511-4871-8c8c-942b3d2fabcb]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:08 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c Sep 11 23:05:08 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:08 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c" returned: 0 in 0.429s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:08 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 1G Sep 11 23:05:08 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:09 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 1G" returned: 0 in 0.426s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1cef5c-6455-474d-823d-bc365f4abd8c -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:09 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1cef5c-6455-474d-823d-bc365f4abd8c -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 Sep 11 23:05:09 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:09 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1cef5c-6455-474d-823d-bc365f4abd8c -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741" returned: 0 in 0.304s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:09 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:05:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:09 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 Sep 11 23:05:09 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:09 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:09 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.info Sep 11 23:05:09 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:10 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.info" returned: 0 in 0.254s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:10 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:10 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.info Sep 11 23:05:10 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:10 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.info" returned: 0 in 0.252s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Acquiring lock "cinder-quobyte-f2de1614-3fb0-4195-8fef-68d789ac2cca" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Lock "cinder-quobyte-f2de1614-3fb0-4195-8fef-68d789ac2cca" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] snapshot: 41fa4756-eff6-4210-a644-c39a1b744741, volume: f2de1614-3fb0-4195-8fef-68d789ac2cca, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9aba3d-63ee-423e-a91c-e01fd0516152]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:10 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 Sep 11 23:05:10 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:10 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741" returned: 0 in 0.360s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d1cef5c-6455-474d-823d-bc365f4abd8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac001781-b2d8-4dae-a4f9-62b6f6c2c649]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:10 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c Sep 11 23:05:10 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:11 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c" returned: 0 in 0.383s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:11 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca Sep 11 23:05:11 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:11 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:11 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:11 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.287s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:05:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Flow 'volume_create_manager' (ee394b17-706b-4dbb-b8c6-e9863d7d28d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d518121a-4bd3-44d8-9bff-147b4c2eddb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d518121a-4bd3-44d8-9bff-147b4c2eddb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-986046535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9eacc8-87f4-4eb5-b18f-929f3b134768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc524214a154b309e5b1b55d5697cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:13Z,use_quota=True,user_id='2370207e153c4a78b3cb002890a8636b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cec445-7a33-43c9-9e08-8810d3f6b6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cec445-7a33-43c9-9e08-8810d3f6b6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de84f4b-2413-444e-b3d4-5f4af952b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de84f4b-2413-444e-b3d4-5f4af952b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9eacc8-87f4-4eb5-b18f-929f3b134768', 'volume_name': 'volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36ae661-8fa5-412c-aa60-f6ae0bb876de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36ae661-8fa5-412c-aa60-f6ae0bb876de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a58fdc9-fe73-4a3d-bfcd-2d134c99c89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768', 'volume_size': 1} Sep 11 23:05:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:16 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca" returned: 0 in 5.560s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:16 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:05:16 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Converted 1024.00 MB image at 184.14 MB/s Sep 11 23:05:16 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca is being set with open permissions: ugo+rw: NotImplementedError Sep 11 23:05:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:16 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca Sep 11 23:05:16 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:17 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca" returned: 0 in 0.489s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Lock "cinder-quobyte-f2de1614-3fb0-4195-8fef-68d789ac2cca" released by "_copy_volume_from_snapshot" :: held 6.863s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Acquiring lock "cinder-quobyte-41fa4756-eff6-4210-a644-c39a1b744741" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Lock "cinder-quobyte-41fa4756-eff6-4210-a644-c39a1b744741" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Deleting offline snapshot 41fa4756-eff6-4210-a644-c39a1b744741 of volume 2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] snapshot_file for this snap is: volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca0b8b3-f282-48ea-8925-d51ae01291fe]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:17 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 Sep 11 23:05:17 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:17 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741" returned: 0 in 0.550s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d1cef5c-6455-474d-823d-bc365f4abd8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff11861-bae1-4655-8dfd-40e06500c10d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:18 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c Sep 11 23:05:18 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-3505460a-0915-400b-9d41-cae52d08ddcd req-5e5194b6-5f9e-430d-8ea5-46d03dfe58b3 tempest-ServerActionsTestOtherA-877327324 None] Terminate volume connection completed successfully. Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-3505460a-0915-400b-9d41-cae52d08ddcd req-5e5194b6-5f9e-430d-8ea5-46d03dfe58b3 tempest-ServerActionsTestOtherA-877327324 None] Deleting attachment 708f0edb-247a-4e18-bc40-e93816b904ac. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "cinder-28b9d7a9-8c6d-4584-a391-11e0c15d3801-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Lock "cinder-28b9d7a9-8c6d-4584-a391-11e0c15d3801-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "cinder-quobyte-28b9d7a9-8c6d-4584-a391-11e0c15d3801" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Lock "cinder-quobyte-28b9d7a9-8c6d-4584-a391-11e0c15d3801" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7fa0dc-899d-4e96-a7b4-699630995111]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:18 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c" returned: 0 in 0.650s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:18 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 Sep 11 23:05:18 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:18 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 Sep 11 23:05:18 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:18 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801" returned: 0 in 0.475s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:19 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801 Sep 11 23:05:19 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:19 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741" returned: 0 in 0.514s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:19 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741 Sep 11 23:05:19 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:19 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-28b9d7a9-8c6d-4584-a391-11e0c15d3801" returned: 0 in 0.298s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Lock "cinder-quobyte-28b9d7a9-8c6d-4584-a391-11e0c15d3801" released by "delete_volume" :: held 0.833s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:19 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c.41fa4756-eff6-4210-a644-c39a1b744741" returned: 0 in 0.290s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Lock "cinder-quobyte-41fa4756-eff6-4210-a644-c39a1b744741" released by "_delete_snapshot" :: held 2.153s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.quota [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Created reservations ['fcb0181b-33de-4ae7-a200-ba2acad6f608', '049ca9e9-2f13-4516-a9a3-3464f4f5c137', '02384216-5948-4d1d-916d-f2edf3ca7d02', 'eeec28af-50ae-4df0-b53f-ef4eefd966d2'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.198s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.112s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-986046535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9eacc8-87f4-4eb5-b18f-929f3b134768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc524214a154b309e5b1b55d5697cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:13Z,use_quota=True,user_id='2370207e153c4a78b3cb002890a8636b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Creating volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:19 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:19 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 1073741824 Sep 11 23:05:19 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:19 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:19 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-15356565-e7de-40f6-9e6c-02654d0cb663 tempest-GroupsV314Test-1841191049 None] Create group from source-group-3c19c4af-0aa3-4473-bd68-a77de15eac9b completed successfully. Sep 11 23:05:19 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "cinder-8b9bb8e8-af60-4616-9998-80f5b30b8261-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Lock "cinder-8b9bb8e8-af60-4616-9998-80f5b30b8261-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "cinder-quobyte-8b9bb8e8-af60-4616-9998-80f5b30b8261" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Lock "cinder-quobyte-8b9bb8e8-af60-4616-9998-80f5b30b8261" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd5cd4e-06ff-4eef-a83a-257e6913dd0e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:19 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.334s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.manager [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:19 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 Sep 11 23:05:19 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:19 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Deleted volume successfully. Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3505460a-0915-400b-9d41-cae52d08ddcd req-2d24b463-07b2-4961-83e1-e755fbea4a2c tempest-ServerActionsTestOtherA-877327324 None] Lock "cinder-28b9d7a9-8c6d-4584-a391-11e0c15d3801-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:19 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 1073741824" returned: 0 in 0.546s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:20 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 Sep 11 23:05:20 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:20 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261" returned: 0 in 0.427s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:20 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261 Sep 11 23:05:20 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:20 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a58fdc9-fe73-4a3d-bfcd-2d134c99c89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b4ada4-390e-428f-aab9-d418e1a0bc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:20 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Volume volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 (9a9eacc8-87f4-4eb5-b18f-929f3b134768): created successfully Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b4ada4-390e-428f-aab9-d418e1a0bc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Flow 'volume_create_manager' (ee394b17-706b-4dbb-b8c6-e9863d7d28d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-502835aa-7eeb-430b-aa12-6a625f621517 tempest-SnapshotsActionsTest-104546578 None] Created volume successfully. Sep 11 23:05:20 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8b9bb8e8-af60-4616-9998-80f5b30b8261" returned: 0 in 0.283s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Lock "cinder-quobyte-8b9bb8e8-af60-4616-9998-80f5b30b8261" released by "delete_volume" :: held 0.761s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Created reservations ['d58f9ac5-1554-42ab-bdac-7108ddc0e457', '9b34312b-11ab-42d0-a784-0d54717d0bb0', '587327b6-d3a0-4733-8fb7-83ba35a4c08d', 'd277381e-dc1a-4f5a-8a27-e7db9ba5c6db'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:20 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:20 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=86,cinder:UPDATE=94,cinder:DELETE=5,cinder:INSERT=14 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=100,cinder:UPDATE=87,cinder:INSERT=22,cinder:DELETE=3 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Acquiring lock "cinder-quobyte-f2de1614-3fb0-4195-8fef-68d789ac2cca" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Lock "cinder-quobyte-f2de1614-3fb0-4195-8fef-68d789ac2cca" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f37523-6e5b-4986-8fdd-59d537c1ae99]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:20 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca Sep 11 23:05:20 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:20 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.314s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Deleted volume successfully. Sep 11 23:05:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-07d3158e-e851-4249-ab03-523a69d30bac tempest-ServerActionsTestOtherA-877327324 None] Lock "cinder-8b9bb8e8-af60-4616-9998-80f5b30b8261-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:21 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca" returned: 0 in 0.510s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:21 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Creating offline snapshot a2ddd26b-3b09-4b05-b5ab-292a09b912c5 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:05:21 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dedb80-a7fc-472f-93f4-cced85398747]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:21 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 Sep 11 23:05:21 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:21 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f2de1614-3fb0-4195-8fef-68d789ac2cca" returned: 0 in 0.373s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Lock "cinder-quobyte-f2de1614-3fb0-4195-8fef-68d789ac2cca" released by "delete_volume" :: held 0.946s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Created reservations ['d8844f9b-37a8-4841-8cba-21367a67f3b5'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:21 devstack cinder-volume[88026]: WARNING cinder.quota [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2091976097 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2091976097, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:05:21 devstack cinder-volume[88026]: WARNING cinder.quota [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2091976097 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2091976097, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Created reservations ['04f6b507-b0b5-4317-b099-6c4267d30ad2', '67ac44f6-bab9-49af-8d86-f0f8a6036864', '08ff8c9b-05f2-4c97-b443-469bea7d3884', 'bfc0f2f1-e46f-4f88-a857-daf4f0d982b6'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:21 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768" returned: 0 in 0.547s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:21 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 1G Sep 11 23:05:21 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:22 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:22 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:22 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.289s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:22 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b01e91dc-6d8b-43a4-a25e-f74e1b6da097 tempest-GroupsV314Test-1841191049 None] Delete group completed successfully. Sep 11 23:05:22 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 1G" returned: 0 in 0.499s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:22 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:22 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:22 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.337s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:22 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 is being set with open permissions: ugo+rw Sep 11 23:05:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:22 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:22 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:22 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.257s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:23 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.info Sep 11 23:05:23 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Acquiring lock "cinder-quobyte-2d1cef5c-6455-474d-823d-bc365f4abd8c" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:23 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.info" returned: 0 in 0.281s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:23 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.info is being set with open permissions: ugo+rw Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Lock "cinder-quobyte-2d1cef5c-6455-474d-823d-bc365f4abd8c" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:23 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.info Sep 11 23:05:23 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c43f89-3b18-433d-96a7-592811fa2b50]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:23 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c Sep 11 23:05:23 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:23 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.info" returned: 0 in 0.254s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:23 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c925b1b9-a2c4-4160-8920-876c3b6ffb57 tempest-SnapshotsActionsTest-104546578 None] Create snapshot completed successfully Sep 11 23:05:23 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c" returned: 0 in 0.384s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:23 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c Sep 11 23:05:23 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:24 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d1cef5c-6455-474d-823d-bc365f4abd8c" returned: 0 in 0.263s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Lock "cinder-quobyte-2d1cef5c-6455-474d-823d-bc365f4abd8c" released by "delete_volume" :: held 0.722s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Created reservations ['34eaef37-00ff-41ef-8e4f-acd89f1750db'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Created reservations ['536b8599-def0-4014-8ab4-18d8cde9950e', '4dae3872-6e94-469e-aa56-c312b0afd77a', '42ff5349-9965-4f7b-8461-d59cee734434', '7ff9304f-89aa-4fe6-a79e-f9df1d1ca8f3'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:24 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:24 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:24 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.307s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:24 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-08255979-402f-42eb-8380-8cb9e73cd9cb tempest-GroupsV314Test-1841191049 None] Delete group completed successfully. Sep 11 23:05:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Creating offline snapshot 1d367e3c-cd8d-486f-b57f-6a280cd92ab9 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:05:25 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef01d52a-aec9-4d59-bedc-3ce24b691fb2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:25 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:25 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:25 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.541s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:25 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 1G Sep 11 23:05:25 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:26 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 1G" returned: 0 in 0.547s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:26 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 Sep 11 23:05:26 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:26 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9" returned: 0 in 0.340s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:26 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 is being set with open permissions: ugo+rw Sep 11 23:05:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:26 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 Sep 11 23:05:26 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:26 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9" returned: 0 in 0.281s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6ccca03e-99e8-423e-8629-ecadb607749f tempest-SnapshotsActionsTest-104546578 None] Create snapshot completed successfully Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-1d367e3c-cd8d-486f-b57f-6a280cd92ab9-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-1d367e3c-cd8d-486f-b57f-6a280cd92ab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-quobyte-1d367e3c-cd8d-486f-b57f-6a280cd92ab9" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-1d367e3c-cd8d-486f-b57f-6a280cd92ab9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Deleting offline snapshot 1d367e3c-cd8d-486f-b57f-6a280cd92ab9 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] snapshot_file for this snap is: volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a46cb7-6311-498b-a83d-49bfe62ef9b1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:27 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 Sep 11 23:05:27 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:27 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9" returned: 0 in 0.473s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab75116-3ec8-46d9-b1dc-24fbfede9532]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:28 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:28 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:28 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.363s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:28 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 Sep 11 23:05:28 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:28 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9" returned: 0 in 0.504s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:28 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9 Sep 11 23:05:28 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:29 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.1d367e3c-cd8d-486f-b57f-6a280cd92ab9" returned: 0 in 0.291s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-1d367e3c-cd8d-486f-b57f-6a280cd92ab9" released by "_delete_snapshot" :: held 1.742s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" released by "delete_snapshot" :: held 1.767s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:29 devstack cinder-volume[88026]: WARNING cinder.quota [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:05:29 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Created reservations ['466aa814-2d1f-4863-8c94-bdad9c6b9a7c', '63503296-ecd0-4270-bff1-6b8995da2bd4', '9490c086-efe9-4e6e-86c3-1a9c243a7101', '75ff50c2-b858-418e-9f5a-c9db348ce3be'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Delete snapshot completed successfully. Sep 11 23:05:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d92fb99a-089c-4c1b-92bf-7b9efb64fc44 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-1d367e3c-cd8d-486f-b57f-6a280cd92ab9-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Creating offline snapshot 856ff340-d90d-4ba5-98fc-bf38243652c9 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:05:30 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[139e6c9e-4116-4765-9851-1554323b8f30]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:30 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:30 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:30 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.388s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:30 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 1G Sep 11 23:05:30 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:30 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 1G" returned: 0 in 0.505s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:30 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 Sep 11 23:05:30 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:31 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:31 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 is being set with open permissions: ugo+rw Sep 11 23:05:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:31 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 Sep 11 23:05:31 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:31 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9" returned: 0 in 0.250s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.589s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:31 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d86d1551-2ffc-4291-a29c-891161c4b325 tempest-SnapshotsActionsTest-104546578 None] Create snapshot completed successfully Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-856ff340-d90d-4ba5-98fc-bf38243652c9-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-856ff340-d90d-4ba5-98fc-bf38243652c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-quobyte-856ff340-d90d-4ba5-98fc-bf38243652c9" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-856ff340-d90d-4ba5-98fc-bf38243652c9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Deleting offline snapshot 856ff340-d90d-4ba5-98fc-bf38243652c9 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] snapshot_file for this snap is: volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca02401-e0aa-441f-a526-f92f0ec5ddd0]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:32 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 Sep 11 23:05:32 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:32 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-03ad8ba9-6b3a-470e-8841-861653256720 req-051f5d40-81b4-417c-ade6-bb5561a90b7a tempest-AttachVolumeTestJSON-1441574395 None] Terminate volume connection completed successfully. Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-03ad8ba9-6b3a-470e-8841-861653256720 req-051f5d40-81b4-417c-ade6-bb5561a90b7a tempest-AttachVolumeTestJSON-1441574395 None] Deleting attachment 8b1c0f8e-c744-45c3-8843-79277eef2c09. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:05:32 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9" returned: 0 in 0.548s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717f6f3-33d8-4afb-8f95-6b428b022583]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:33 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:33 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Flow 'volume_create_manager' (bb58d8d1-71b3-4c44-b975-25825b75a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cfa819-c3a6-4f66-b522-cfe7cca41f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cfa819-c3a6-4f66-b522-cfe7cca41f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1890353365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbcd669-91ee-4b9a-b49f-35a76ee97bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14787d3cc26c48a096a221987d0185a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:33Z,use_quota=True,user_id='94cb2a391d3c4943b81211a41c15ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5c795e-3151-40fe-8b8a-42182d278340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5c795e-3151-40fe-8b8a-42182d278340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38785ce-61e5-4b42-bef9-255e01e14b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38785ce-61e5-4b42-bef9-255e01e14b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbcd669-91ee-4b9a-b49f-35a76ee97bbf', 'volume_name': 'volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21e0608-6897-4ee7-9341-1b760beef0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21e0608-6897-4ee7-9341-1b760beef0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95907eec-6d1a-49a3-b479-2bad571a49ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:33 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Volume 3bbcd669-91ee-4b9a-b49f-35a76ee97bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf', 'volume_size': 1} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1890353365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbcd669-91ee-4b9a-b49f-35a76ee97bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14787d3cc26c48a096a221987d0185a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:33Z,use_quota=True,user_id='94cb2a391d3c4943b81211a41c15ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Creating volume 3bbcd669-91ee-4b9a-b49f-35a76ee97bbf {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:33 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:33 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf 1073741824 Sep 11 23:05:33 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:33 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.579s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:33 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 Sep 11 23:05:33 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Flow 'volume_create_manager' (d61a14c1-bf18-4455-a9b6-1bea9b5a141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18d1a7f-309b-49ab-a6b6-af6ff1bbe2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:34 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18d1a7f-309b-49ab-a6b6-af6ff1bbe2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-432864661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600790b3-144e-4617-982f-d13ac474a285,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bd4ce5069214a6db6a2f314bd8cee53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:34Z,use_quota=True,user_id='6bb6b309cef74da4ab5d89cfb62cff61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907c0c8b-69ea-4696-b210-7ec19b015101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907c0c8b-69ea-4696-b210-7ec19b015101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f877b617-2da5-450c-997a-4f8917b6eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f877b617-2da5-450c-997a-4f8917b6eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600790b3-144e-4617-982f-d13ac474a285', 'volume_name': 'volume-600790b3-144e-4617-982f-d13ac474a285', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6aa1423-e427-46f4-a96a-2d36bf4b5a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6aa1423-e427-46f4-a96a-2d36bf4b5a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd12538d-5cb9-4fe3-8bb6-269f76d296db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Volume 600790b3-144e-4617-982f-d13ac474a285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600790b3-144e-4617-982f-d13ac474a285', 'volume_size': 1} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf 1073741824" returned: 0 in 0.861s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:34 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9" returned: 0 in 0.580s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:34 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf Sep 11 23:05:34 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:34 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9 Sep 11 23:05:34 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:34 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf" returned: 0 in 0.244s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-432864661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600790b3-144e-4617-982f-d13ac474a285,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3bd4ce5069214a6db6a2f314bd8cee53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:34Z,use_quota=True,user_id='6bb6b309cef74da4ab5d89cfb62cff61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Creating volume 600790b3-144e-4617-982f-d13ac474a285 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:34 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95907eec-6d1a-49a3-b479-2bad571a49ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2429976-8439-4df4-b1f5-f2b161fc59f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:34 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 1073741824 Sep 11 23:05:34 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:34 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.856ff340-d90d-4ba5-98fc-bf38243652c9" returned: 0 in 0.287s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Volume volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf (3bbcd669-91ee-4b9a-b49f-35a76ee97bbf): created successfully Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2429976-8439-4df4-b1f5-f2b161fc59f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Flow 'volume_create_manager' (bb58d8d1-71b3-4c44-b975-25825b75a6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-856ff340-d90d-4ba5-98fc-bf38243652c9" released by "_delete_snapshot" :: held 2.163s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1bf1b08f-4de9-400a-90c9-a3ee9aed3315 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Created volume successfully. Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" released by "delete_snapshot" :: held 2.204s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Created reservations ['00163bee-e79c-4c54-8a35-111e26ab0ec4', '57c73a5f-43fa-49d1-bba6-65edade79346', '306f3bc6-ee27-42c5-b2ae-a67b7bf91ad2', '15024572-7868-45d4-8ae9-8e41e2efe024'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Delete snapshot completed successfully. Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1bfcf88f-98fc-433c-a026-9325059acb47 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-856ff340-d90d-4ba5-98fc-bf38243652c9-delete_snapshot" released by "delete_snapshot" :: held 2.373s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:34 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 1073741824" returned: 0 in 0.437s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:34 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 Sep 11 23:05:34 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:35 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285" returned: 0 in 0.273s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd12538d-5cb9-4fe3-8bb6-269f76d296db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600790b3-144e-4617-982f-d13ac474a285', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9102fa09-66f0-42bc-b438-de56eb16edfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:35 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Volume volume-600790b3-144e-4617-982f-d13ac474a285 (600790b3-144e-4617-982f-d13ac474a285): created successfully Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9102fa09-66f0-42bc-b438-de56eb16edfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Flow 'volume_create_manager' (d61a14c1-bf18-4455-a9b6-1bea9b5a141a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:35 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-8e447f3d-b7e5-4a77-a3f6-8bc9933af230 req-c19816bb-da50-4e4f-b4ae-91473ed9dde1 tempest-VolumesGetTestJSON-404887772 None] Created volume successfully. Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Acquiring lock "cinder-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "cinder-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Acquiring lock "cinder-quobyte-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "cinder-quobyte-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[495597e9-925a-4d9d-afc7-99039a1f79a1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:35 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf Sep 11 23:05:35 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:35 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf" returned: 0 in 0.495s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Creating offline snapshot 7b9a9087-ccdd-414a-9bd9-c2cbba98c397 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:05:36 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf Sep 11 23:05:36 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[623547ad-89f1-4dc1-8a6b-99c83c530106]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:36 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:36 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:36 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf" returned: 0 in 0.294s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "cinder-quobyte-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf" released by "delete_volume" :: held 0.853s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Created reservations ['9c9f1a87-4a77-4c4d-8b8f-139dc95354ea', '77875827-0944-47d7-87cf-88d0a47dd482', '275b6338-ff90-46e2-8137-a77539da9ad4', '10c33db3-208b-4d67-9b10-b0f3101067dc'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Acquiring lock "cinder-600790b3-144e-4617-982f-d13ac474a285-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Lock "cinder-600790b3-144e-4617-982f-d13ac474a285-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:36 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:36 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:36 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.581s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:36 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 1G Sep 11 23:05:36 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Acquiring lock "cinder-quobyte-600790b3-144e-4617-982f-d13ac474a285" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Lock "cinder-quobyte-600790b3-144e-4617-982f-d13ac474a285" acquired by "delete_volume" :: waited 0.061s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[197a49e5-1183-401a-8eeb-7dbde2e888c6]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:37 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.554s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:37 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 Sep 11 23:05:37 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Deleted volume successfully. Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f51659a-8665-4596-b507-123ca4bbf123 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "cinder-3bbcd669-91ee-4b9a-b49f-35a76ee97bbf-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:37 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285" returned: 0 in 0.577s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:37 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285 Sep 11 23:05:37 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:37 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 1G" returned: 0 in 1.065s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:05:37 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 Sep 11 23:05:37 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Flow 'volume_create_manager' (c006de78-e4fe-42a2-98f0-a29ba9183eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6309d626-3531-4ba5-8fb7-5f56d28bb48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6309d626-3531-4ba5-8fb7-5f56d28bb48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1170332420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14787d3cc26c48a096a221987d0185a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:38Z,use_quota=True,user_id='94cb2a391d3c4943b81211a41c15ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9dc30c-ab65-4d83-b272-bd3d0671d03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9dc30c-ab65-4d83-b272-bd3d0671d03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e780c83-252a-459f-83c8-83206337255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e780c83-252a-459f-83c8-83206337255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d', 'volume_name': 'volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b8bd01-2450-42a1-93d2-cbef3f1c9331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b8bd01-2450-42a1-93d2-cbef3f1c9331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b880e1-d653-4e10-b9c1-a19fbdb874e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:37 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Volume 392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d', 'volume_size': 1} Sep 11 23:05:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:38 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-600790b3-144e-4617-982f-d13ac474a285" returned: 0 in 0.615s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Lock "cinder-quobyte-600790b3-144e-4617-982f-d13ac474a285" released by "delete_volume" :: held 1.305s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.quota [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Created reservations ['2cef2d1d-77e1-4be5-a277-aa2f57d1ddb5', 'a1e95a7d-ea65-4ab3-9373-0f87314fd0d0', '9bcc1b01-1e47-4e70-8295-a2988116c42d', '345b2819-fd0f-4633-a7c0-396b6ab2dde5'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:38 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397" returned: 0 in 0.618s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:38 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 is being set with open permissions: ugo+rw Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:38 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 Sep 11 23:05:38 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:38 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:38 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:38 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397" returned: 0 in 0.502s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:38 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.959s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1170332420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14787d3cc26c48a096a221987d0185a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:38Z,use_quota=True,user_id='94cb2a391d3c4943b81211a41c15ba1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Creating volume 392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:05:38 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:05:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:39 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d 1073741824 Sep 11 23:05:39 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.551s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.manager [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:39 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Deleted volume successfully. Sep 11 23:05:39 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5fd8b76d-00c8-4e96-a57b-ed5a151aac05 tempest-SnapshotsActionsTest-104546578 None] Create snapshot completed successfully Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-50f968a3-463c-4a67-9650-edfc79b475ee req-845d40d3-a54e-4cc3-8ae0-7cee0a296459 tempest-VolumesGetTestJSON-404887772 None] Lock "cinder-600790b3-144e-4617-982f-d13ac474a285-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-7b9a9087-ccdd-414a-9bd9-c2cbba98c397-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-7b9a9087-ccdd-414a-9bd9-c2cbba98c397-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-quobyte-7b9a9087-ccdd-414a-9bd9-c2cbba98c397" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-7b9a9087-ccdd-414a-9bd9-c2cbba98c397" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Deleting offline snapshot 7b9a9087-ccdd-414a-9bd9-c2cbba98c397 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] snapshot_file for this snap is: volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0e292-1c3b-4363-99ad-8dc410752a97]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:39 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 Sep 11 23:05:39 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:39 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d 1073741824" returned: 0 in 0.986s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:40 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d Sep 11 23:05:40 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:40 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397" returned: 0 in 0.607s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba421a2-8a66-419b-9439-28ea6d25b325]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:40 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d" returned: 0 in 0.360s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b880e1-d653-4e10-b9c1-a19fbdb874e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:40 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:40 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10912bb-902b-4bd0-8112-847a0aeaaea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:05:40 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Volume volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d (392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d): created successfully Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10912bb-902b-4bd0-8112-847a0aeaaea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Flow 'volume_create_manager' (c006de78-e4fe-42a2-98f0-a29ba9183eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:05:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-190fd4b9-c987-400b-8dfc-70263005a675 tempest-VolumeQuotasAdminTestJSON-1270895183 None] Created volume successfully. Sep 11 23:05:40 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.570s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:40 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 Sep 11 23:05:40 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:41 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397" returned: 0 in 0.600s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:41 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397 Sep 11 23:05:41 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:41 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.7b9a9087-ccdd-414a-9bd9-c2cbba98c397" returned: 0 in 0.307s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-7b9a9087-ccdd-414a-9bd9-c2cbba98c397" released by "_delete_snapshot" :: held 2.259s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" released by "delete_snapshot" :: held 2.301s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:41 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Created reservations ['4323c152-8fbc-44c6-8298-e4edc611d682', 'e6dd30f8-51a1-4307-a676-589802d27795', 'a9b455f4-44b3-4799-b45c-e6dcc945f624', 'f6cc2ccd-a465-477b-8e45-25c93ba2e171'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Delete snapshot completed successfully. Sep 11 23:05:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9957bbe9-ecdd-4282-a1f3-a877d69ed9ba tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-7b9a9087-ccdd-414a-9bd9-c2cbba98c397-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b6f9fec0-4cff-4c5a-afcb-84a079f4628c tempest-VolumeQuotasAdminTestJSON-28376057 None] Transfer volume completed successfully. Sep 11 23:05:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Acquiring lock "cinder-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Lock "cinder-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Acquiring lock "cinder-quobyte-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Lock "cinder-quobyte-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1671bdf-6429-4e22-b9e2-7ca28e564ccf]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:43 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d Sep 11 23:05:43 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Creating offline snapshot d8c38853-71b7-4155-ba8d-f0162280f001 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f621a108-95e5-419e-9165-4efa661d9f69]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:43 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:43 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:43 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:43 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d Sep 11 23:05:43 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:43 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.463s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:43 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 1G Sep 11 23:05:43 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:43 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d" returned: 0 in 0.314s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Lock "cinder-quobyte-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d" released by "delete_volume" :: held 0.838s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:43 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Created reservations ['c4a27878-5943-40fa-982e-721c6a594a62', '3fd1e90c-35ed-45df-82fb-386c8451113a', '03964988-69c4-431f-b16c-9a3b0c9622b2', '8c8bdc69-ad7e-4c1c-8d1b-79309f883ca7'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:44 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:44 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:44 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 1G" returned: 0 in 0.656s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:44 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.359s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Deleted volume successfully. Sep 11 23:05:44 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 Sep 11 23:05:44 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7cf2a0f4-5dda-4c20-96ea-16b3925a3e99 tempest-VolumeQuotasAdminTestJSON-513664780 None] Lock "cinder-392b2f0c-f83f-42c5-bf73-8fe2c09b5b0d-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:44 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001" returned: 0 in 0.370s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:44 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 is being set with open permissions: ugo+rw Sep 11 23:05:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:44 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 Sep 11 23:05:44 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:45 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001" returned: 0 in 0.361s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-403fe6f4-7dbb-4ec9-8c13-58030f0f1294 tempest-SnapshotsActionsTest-104546578 None] Create snapshot completed successfully Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-d8c38853-71b7-4155-ba8d-f0162280f001-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-d8c38853-71b7-4155-ba8d-f0162280f001-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Acquiring lock "cinder-quobyte-d8c38853-71b7-4155-ba8d-f0162280f001" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-d8c38853-71b7-4155-ba8d-f0162280f001" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Deleting offline snapshot d8c38853-71b7-4155-ba8d-f0162280f001 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] snapshot_file for this snap is: volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b7148d-114b-4a16-932b-18e1747b3303]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:45 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 Sep 11 23:05:45 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:46 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001" returned: 0 in 0.448s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a0b425-9382-427c-a84e-a45dfefa36a3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:46 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:46 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:46 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.568s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:46 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 Sep 11 23:05:46 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:47 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001" returned: 0 in 0.560s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:47 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001 Sep 11 23:05:47 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:47 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.d8c38853-71b7-4155-ba8d-f0162280f001" returned: 0 in 0.421s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-d8c38853-71b7-4155-ba8d-f0162280f001" released by "_delete_snapshot" :: held 2.139s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" released by "delete_snapshot" :: held 2.176s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:47 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Created reservations ['b322753d-f593-4148-8126-498c3e518867', '02ba6e53-b015-40a5-98a0-b2660fc74373', 'c5a7cce7-d09d-4b88-8e9d-87b615f2dd0a', 'a0cc4a68-1efc-4885-b904-63e64231f360'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Delete snapshot completed successfully. Sep 11 23:05:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a4c7127-ab64-4c0a-9233-aebf57bf9017 tempest-SnapshotsActionsTest-569318821 None] Lock "cinder-d8c38853-71b7-4155-ba8d-f0162280f001-delete_snapshot" released by "delete_snapshot" :: held 2.401s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "cinder-a2ddd26b-3b09-4b05-b5ab-292a09b912c5-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-a2ddd26b-3b09-4b05-b5ab-292a09b912c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "cinder-quobyte-a2ddd26b-3b09-4b05-b5ab-292a09b912c5" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-quobyte-a2ddd26b-3b09-4b05-b5ab-292a09b912c5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Deleting offline snapshot a2ddd26b-3b09-4b05-b5ab-292a09b912c5 of volume 9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] snapshot_file for this snap is: volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[15165fbd-437b-4d59-83f4-d60b9aae7faf]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:49 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:49 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:50 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.599s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:05:50 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81d143-8b33-4494-b9c2-5e1c5e54abf0]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:50 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 Sep 11 23:05:50 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:50 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768" returned: 0 in 0.592s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:50 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:50 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:51 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.384s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:51 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5 Sep 11 23:05:51 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:51 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768.a2ddd26b-3b09-4b05-b5ab-292a09b912c5" returned: 0 in 0.306s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-quobyte-a2ddd26b-3b09-4b05-b5ab-292a09b912c5" released by "_delete_snapshot" :: held 2.068s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" released by "delete_snapshot" :: held 2.103s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:51 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Created reservations ['cf9e665e-9672-400f-a4de-cd39118d2e49', '0e7764ce-2ee0-414f-902f-b228dc030728', '951fc471-4908-4f3b-8102-df8a09f367a8', '07d22df7-6918-4118-82ad-7e82b5242c27'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Delete snapshot completed successfully. Sep 11 23:05:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ec36c72-c453-417a-ab7c-8971d7c2f25f tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-a2ddd26b-3b09-4b05-b5ab-292a09b912c5-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "cinder-9a9eacc8-87f4-4eb5-b18f-929f3b134768-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-9a9eacc8-87f4-4eb5-b18f-929f3b134768-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:05:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:05:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f8a86c-8246-4b34-8437-d4c920a039fd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:05:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:53 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 Sep 11 23:05:53 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:53 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768" returned: 0 in 0.395s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:53 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768 Sep 11 23:05:53 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:53 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9a9eacc8-87f4-4eb5-b18f-929f3b134768" returned: 0 in 0.285s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-quobyte-9a9eacc8-87f4-4eb5-b18f-929f3b134768" released by "delete_volume" :: held 0.750s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Created reservations ['a1ff2ba7-8e91-4019-840d-00ad78a335e7', '1515a1ef-a528-4acd-86d3-71dfb60cd0e6', 'b030d4c5-a43e-46f8-ad79-98db47092954', '2b7e2dfc-95f4-44f6-819b-f8090be9a84f'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:05:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:05:53 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:05:53 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:05:54 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 11 23:05:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:05:54 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:05:54 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Deleted volume successfully. Sep 11 23:05:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f34e0d59-1f6e-4c2f-b0e2-0007fe7a8142 tempest-SnapshotsActionsTest-104546578 None] Lock "cinder-9a9eacc8-87f4-4eb5-b18f-929f3b134768-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:03 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:DELETE=8,cinder:UPDATE=93,cinder:SELECT=78,cinder:INSERT=31 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:06:04 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=83,cinder:UPDATE=97,cinder:INSERT=19,cinder:DELETE=5 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Flow 'volume_create_manager' (057e4ed6-2c56-4745-aed2-b65478cc3e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cffa0df-2c0a-420e-9936-d3ef0a112537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cffa0df-2c0a-420e-9936-d3ef0a112537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-582757663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a0811d-da41-43bf-a3fd-ba5dde3b9ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8192006fae794c35919418f154853096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:08Z,use_quota=True,user_id='881e0c74051146eb896c0a267a41376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6267c837-2758-4285-9eac-ee6e0e944134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6267c837-2758-4285-9eac-ee6e0e944134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1075449-3b2a-49e5-ba1b-e452a2ed5a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1075449-3b2a-49e5-ba1b-e452a2ed5a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a0811d-da41-43bf-a3fd-ba5dde3b9ff1', 'volume_name': 'volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22729ee7-fee7-4ce8-b738-f3c4bf012f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22729ee7-fee7-4ce8-b738-f3c4bf012f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d97bc24-db43-44a6-848c-a8f5652c449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:07 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Volume 64a0811d-da41-43bf-a3fd-ba5dde3b9ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1', 'volume_size': 1} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-582757663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a0811d-da41-43bf-a3fd-ba5dde3b9ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8192006fae794c35919418f154853096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:08Z,use_quota=True,user_id='881e0c74051146eb896c0a267a41376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Creating volume 64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:07 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:07 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 1073741824 Sep 11 23:06:07 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:08 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 1073741824" returned: 0 in 0.607s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:08 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 Sep 11 23:06:08 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:08 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1" returned: 0 in 0.309s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d97bc24-db43-44a6-848c-a8f5652c449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ce827f-7986-405e-8c51-5ecbc571735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:08 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Volume volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 (64a0811d-da41-43bf-a3fd-ba5dde3b9ff1): created successfully Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ce827f-7986-405e-8c51-5ecbc571735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Flow 'volume_create_manager' (057e4ed6-2c56-4745-aed2-b65478cc3e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:08 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-58fb2afc-59d2-433a-bbde-0020e7392c4c tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Created volume successfully. Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Acquiring lock "cinder-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "cinder-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Acquiring lock "cinder-quobyte-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "cinder-quobyte-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[458b34b3-ce5e-4b27-9064-70864a11671d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:11 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:11 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:11 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 Sep 11 23:06:11 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:11 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.514s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:06:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:06:12 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1" returned: 0 in 0.607s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:12 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1 Sep 11 23:06:12 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:12 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1" returned: 0 in 0.480s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "cinder-quobyte-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1" released by "delete_volume" :: held 1.158s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Created reservations ['822b028e-73b1-4b77-a8de-5d43e43c659f', 'e637c94c-efbe-4202-b571-f21315e77512', '3d24a4d6-2c8b-431d-ba22-1eb78be82ab8', '0e592d20-2bd3-45d5-b460-b43e46bf1316'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:12 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:12 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:13 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:13 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:13 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Deleted volume successfully. Sep 11 23:06:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-951a148b-5daa-4a79-9594-ac0bde353a0b tempest-VolumeQuotasNegativeTestJSON-1843709187 None] Lock "cinder-64a0811d-da41-43bf-a3fd-ba5dde3b9ff1-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Flow 'volume_create_manager' (784b73cd-405c-4fcb-adde-419f5f7e7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4b3646-a498-4256-b260-bcbc90780cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4b3646-a498-4256-b260-bcbc90780cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1978521817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3b9e67-599a-40c3-90ec-c25341394ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1357c81b04c4265bd6d86b09afee81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:17Z,use_quota=True,user_id='e1a174c70490462fb55af8dbef88ec21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848411a6-2115-4ecb-bf6e-9d3cbcc1a4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848411a6-2115-4ecb-bf6e-9d3cbcc1a4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b42165-7484-4651-a649-abcae0075782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b42165-7484-4651-a649-abcae0075782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3b9e67-599a-40c3-90ec-c25341394ba5', 'volume_name': 'volume-be3b9e67-599a-40c3-90ec-c25341394ba5', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f716ccd-3b5d-46d8-be8a-20f6865edd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f716ccd-3b5d-46d8-be8a-20f6865edd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2719b279-5a27-4c8f-aba9-8c5cbcc6ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:16 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Volume be3b9e67-599a-40c3-90ec-c25341394ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3b9e67-599a-40c3-90ec-c25341394ba5', 'volume_size': 1} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1978521817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3b9e67-599a-40c3-90ec-c25341394ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1357c81b04c4265bd6d86b09afee81f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:17Z,use_quota=True,user_id='e1a174c70490462fb55af8dbef88ec21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Creating volume be3b9e67-599a-40c3-90ec-c25341394ba5 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:16 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:16 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 1073741824 Sep 11 23:06:16 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:17 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 1073741824" returned: 0 in 0.526s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:17 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 Sep 11 23:06:17 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:17 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5" returned: 0 in 0.303s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2719b279-5a27-4c8f-aba9-8c5cbcc6ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3b9e67-599a-40c3-90ec-c25341394ba5', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d02c6c-b302-4fc3-9f29-e723d5a52fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:17 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Volume volume-be3b9e67-599a-40c3-90ec-c25341394ba5 (be3b9e67-599a-40c3-90ec-c25341394ba5): created successfully Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d02c6c-b302-4fc3-9f29-e723d5a52fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Flow 'volume_create_manager' (784b73cd-405c-4fcb-adde-419f5f7e7267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:17 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e2de248a-bafe-48ca-b8f3-ba3e85cad716 tempest-SnapshotMetadataTestJSON-1732382725 None] Created volume successfully. Sep 11 23:06:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Creating offline snapshot 7f5c4370-1945-41ee-ad32-5adec3b7ddb9 of volume be3b9e67-599a-40c3-90ec-c25341394ba5 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:06:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fb93f9-28ef-4de8-bc82-f486a7a5fa64]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:19 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 Sep 11 23:06:19 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:19 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5" returned: 0 in 0.615s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:19 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 1G Sep 11 23:06:19 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:20 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 1G" returned: 0 in 0.758s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b9e67-599a-40c3-90ec-c25341394ba5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:20 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b9e67-599a-40c3-90ec-c25341394ba5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 Sep 11 23:06:20 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:21 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3b9e67-599a-40c3-90ec-c25341394ba5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9" returned: 0 in 0.556s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:21 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 is being set with open permissions: ugo+rw Sep 11 23:06:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:21 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 Sep 11 23:06:21 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:21 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9" returned: 0 in 0.386s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:21 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.info Sep 11 23:06:21 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:21 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.info" returned: 0 in 0.296s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:21 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.info is being set with open permissions: ugo+rw Sep 11 23:06:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:21 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.info Sep 11 23:06:21 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:22 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.info" returned: 0 in 0.345s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.091s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:22 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a4daf9cb-a1ca-4131-a866-866f926c5e78 tempest-SnapshotMetadataTestJSON-1732382725 None] Create snapshot completed successfully Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Flow 'volume_create_manager' (b7c31cc5-b018-4b96-a341-d09901d464f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddb66b4-e9d3-4f3c-9ed3-402519bb6885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddb66b4-e9d3-4f3c-9ed3-402519bb6885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-910615037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef58df02-57e7-4136-bc7b-d105f1a9622b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213c0edfe9bf4c92821f40b1b5c46d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:23Z,use_quota=True,user_id='076fd7645f1445439dd4e84ddaa5623d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95bbad4-8ce9-457a-a29f-4373800f77ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95bbad4-8ce9-457a-a29f-4373800f77ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bc77ba-ad4f-40d6-8596-87b0a6a02842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bc77ba-ad4f-40d6-8596-87b0a6a02842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef58df02-57e7-4136-bc7b-d105f1a9622b', 'volume_name': 'volume-ef58df02-57e7-4136-bc7b-d105f1a9622b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b5ae2d-99ef-4ebe-9620-86d17805ba3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b5ae2d-99ef-4ebe-9620-86d17805ba3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa05b37-9729-44b8-9314-c68bfea52527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:23 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Volume ef58df02-57e7-4136-bc7b-d105f1a9622b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef58df02-57e7-4136-bc7b-d105f1a9622b', 'volume_size': 1} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-910615037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef58df02-57e7-4136-bc7b-d105f1a9622b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213c0edfe9bf4c92821f40b1b5c46d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:23Z,use_quota=True,user_id='076fd7645f1445439dd4e84ddaa5623d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Creating volume ef58df02-57e7-4136-bc7b-d105f1a9622b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:23 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:23 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b 1073741824 Sep 11 23:06:23 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "cinder-7f5c4370-1945-41ee-ad32-5adec3b7ddb9-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-7f5c4370-1945-41ee-ad32-5adec3b7ddb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "cinder-quobyte-be3b9e67-599a-40c3-90ec-c25341394ba5" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-quobyte-be3b9e67-599a-40c3-90ec-c25341394ba5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "cinder-quobyte-7f5c4370-1945-41ee-ad32-5adec3b7ddb9" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-quobyte-7f5c4370-1945-41ee-ad32-5adec3b7ddb9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Deleting offline snapshot 7f5c4370-1945-41ee-ad32-5adec3b7ddb9 of volume be3b9e67-599a-40c3-90ec-c25341394ba5 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] snapshot_file for this snap is: volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba0fd14-76bd-499a-8921-174aab22fdfb]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:23 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 Sep 11 23:06:23 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:24 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9" returned: 0 in 0.489s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be3b9e67-599a-40c3-90ec-c25341394ba5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:06:24 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b 1073741824" returned: 0 in 0.727s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e1172d-288e-4aa9-b4d9-131d0ccdfbd8]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:24 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b Sep 11 23:06:24 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:24 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 Sep 11 23:06:24 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:24 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b" returned: 0 in 0.401s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa05b37-9729-44b8-9314-c68bfea52527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef58df02-57e7-4136-bc7b-d105f1a9622b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde232a0-83fa-4fc9-8a9c-48904142d529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:24 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Volume volume-ef58df02-57e7-4136-bc7b-d105f1a9622b (ef58df02-57e7-4136-bc7b-d105f1a9622b): created successfully Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde232a0-83fa-4fc9-8a9c-48904142d529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Flow 'volume_create_manager' (b7c31cc5-b018-4b96-a341-d09901d464f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2de30916-772c-460c-bf01-570f6486d21c tempest-VolumesServicesTestJSON-583532251 None] Created volume successfully. Sep 11 23:06:24 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5" returned: 0 in 0.671s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:25 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 Sep 11 23:06:25 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:25 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9" returned: 0 in 0.393s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:25 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9 Sep 11 23:06:25 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Acquiring lock "cinder-ef58df02-57e7-4136-bc7b-d105f1a9622b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Lock "cinder-ef58df02-57e7-4136-bc7b-d105f1a9622b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:25 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5.7f5c4370-1945-41ee-ad32-5adec3b7ddb9" returned: 0 in 0.317s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Acquiring lock "cinder-quobyte-ef58df02-57e7-4136-bc7b-d105f1a9622b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Lock "cinder-quobyte-ef58df02-57e7-4136-bc7b-d105f1a9622b" acquired by "delete_volume" :: waited 0.051s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-quobyte-7f5c4370-1945-41ee-ad32-5adec3b7ddb9" released by "_delete_snapshot" :: held 2.061s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-quobyte-be3b9e67-599a-40c3-90ec-c25341394ba5" released by "delete_snapshot" :: held 2.092s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe142e5-4e80-4037-9c86-f6cc7f7f6144]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:25 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Created reservations ['f0ff019a-a62b-4d3e-aa7b-86125c9a5191', '4eed4b82-9ee4-4037-a73e-d8040138a061', '94aca0a2-8513-47f0-a6cd-176852ad38f9', '7017f35c-7210-4477-bb1c-8595f013c5b5'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Delete snapshot completed successfully. Sep 11 23:06:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-152f1dfd-cb46-41ea-a3f1-d3d934a8fd3f tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-7f5c4370-1945-41ee-ad32-5adec3b7ddb9-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:26 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b Sep 11 23:06:26 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:26 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b" returned: 0 in 0.561s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:26 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b Sep 11 23:06:26 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:26 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ef58df02-57e7-4136-bc7b-d105f1a9622b" returned: 0 in 0.529s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Lock "cinder-quobyte-ef58df02-57e7-4136-bc7b-d105f1a9622b" released by "delete_volume" :: held 1.228s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Created reservations ['24e769a1-f7b9-4b34-9fb5-006228645cfb', '71d15ade-5be7-4079-a091-77d743ffaf6b', '52f3b6bc-bde2-4a7f-9eab-f278f51609f1', 'b3bc838c-639e-4489-93f5-d19ee27d0199'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "cinder-be3b9e67-599a-40c3-90ec-c25341394ba5-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-be3b9e67-599a-40c3-90ec-c25341394ba5-delete_volume" acquired by "delete_volume" :: waited 0.176s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:27 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:27 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "cinder-quobyte-be3b9e67-599a-40c3-90ec-c25341394ba5" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-quobyte-be3b9e67-599a-40c3-90ec-c25341394ba5" acquired by "delete_volume" :: waited 0.044s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88bbaf5-f85c-405e-9655-361c6e08287c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:27 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.493s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:27 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Deleted volume successfully. Sep 11 23:06:27 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 Sep 11 23:06:27 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cc965dab-c965-4e25-86df-f9dd0d8214b9 tempest-VolumesServicesTestJSON-583532251 None] Lock "cinder-ef58df02-57e7-4136-bc7b-d105f1a9622b-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:28 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5" returned: 0 in 0.768s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:28 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5 Sep 11 23:06:28 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:28 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-be3b9e67-599a-40c3-90ec-c25341394ba5" returned: 0 in 0.366s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-quobyte-be3b9e67-599a-40c3-90ec-c25341394ba5" released by "delete_volume" :: held 1.278s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:28 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Created reservations ['148862bd-9f21-4e48-b767-5b1b3faf7e6d', '9ac46747-3ed3-4455-b0d1-dd6422f01bd1', 'a2855854-2047-4fe4-b8d1-f49198695447', '8216264d-6a0f-4bfa-b7cb-502363756d20'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:29 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:29 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:29 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.530s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Deleted volume successfully. Sep 11 23:06:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ca2ef83e-8e82-4804-99df-799d3ddb1d85 tempest-SnapshotMetadataTestJSON-1732382725 None] Lock "cinder-be3b9e67-599a-40c3-90ec-c25341394ba5-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=36,cinder:SELECT=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Flow 'volume_create_manager' (7a0b5123-74cb-4d94-b970-b631ae609cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1375246-1c2e-4675-82c7-97b104c2d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1375246-1c2e-4675-82c7-97b104c2d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1776550971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b443a14-97ec-4547-9666-dd8017370cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f92888f2544972812bbf78d8960049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:39Z,use_quota=True,user_id='fdf75f7b82294f37889d464a8d7fe7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7279512-d120-48fd-9ada-92ec93fb9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7279512-d120-48fd-9ada-92ec93fb9719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28383e77-326e-426d-87bf-97e251589704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28383e77-326e-426d-87bf-97e251589704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b443a14-97ec-4547-9666-dd8017370cf7', 'volume_name': 'volume-6b443a14-97ec-4547-9666-dd8017370cf7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dfab01-d501-423f-bda2-56b7e3232cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dfab01-d501-423f-bda2-56b7e3232cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b47c03-850d-4daa-8acf-60920a42aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:39 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Volume 6b443a14-97ec-4547-9666-dd8017370cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b443a14-97ec-4547-9666-dd8017370cf7', 'volume_size': 1} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1776550971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b443a14-97ec-4547-9666-dd8017370cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f92888f2544972812bbf78d8960049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:39Z,use_quota=True,user_id='fdf75f7b82294f37889d464a8d7fe7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Creating volume 6b443a14-97ec-4547-9666-dd8017370cf7 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:39 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:39 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 1073741824 Sep 11 23:06:39 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:40 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 1073741824" returned: 0 in 0.684s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:40 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 Sep 11 23:06:40 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:40 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7" returned: 0 in 0.636s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b47c03-850d-4daa-8acf-60920a42aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b443a14-97ec-4547-9666-dd8017370cf7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74441c0-b802-4e14-b876-f68e9f1a3baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Volume volume-6b443a14-97ec-4547-9666-dd8017370cf7 (6b443a14-97ec-4547-9666-dd8017370cf7): created successfully Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74441c0-b802-4e14-b876-f68e9f1a3baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Flow 'volume_create_manager' (7a0b5123-74cb-4d94-b970-b631ae609cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:41 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a7f7bcfd-b21e-46bb-91f9-cfd8787266f7 tempest-AbsoluteLimitsTests-1400859853 None] Created volume successfully. Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Flow 'volume_create_manager' (919cda7c-d6b6-4c48-9854-c2c092c764cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce58417-9df0-454d-a753-b8e68d246796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce58417-9df0-454d-a753-b8e68d246796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-819312428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e3a2ac-d60d-45e5-a5bb-a651cf72799e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9bda16fcebe47d4b96c3b3bb7d69eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:41Z,use_quota=True,user_id='f9bd554ffd1344aea01aa3f97de09a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d7e850-87e8-45d9-b7c2-af51ff3438bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d7e850-87e8-45d9-b7c2-af51ff3438bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85194867-a522-4d4e-a261-16f4eda39c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85194867-a522-4d4e-a261-16f4eda39c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e3a2ac-d60d-45e5-a5bb-a651cf72799e', 'volume_name': 'volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9c7a03-5214-430d-9039-a3826066fc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9c7a03-5214-430d-9039-a3826066fc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467cee39-2eb1-4ed1-b652-ee669968710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Volume f3e3a2ac-d60d-45e5-a5bb-a651cf72799e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e', 'volume_size': 1} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-819312428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e3a2ac-d60d-45e5-a5bb-a651cf72799e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9bda16fcebe47d4b96c3b3bb7d69eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:41Z,use_quota=True,user_id='f9bd554ffd1344aea01aa3f97de09a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Creating volume f3e3a2ac-d60d-45e5-a5bb-a651cf72799e {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:41 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:41 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e 1073741824 Sep 11 23:06:41 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Acquiring lock "cinder-6b443a14-97ec-4547-9666-dd8017370cf7-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "cinder-6b443a14-97ec-4547-9666-dd8017370cf7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Acquiring lock "cinder-quobyte-6b443a14-97ec-4547-9666-dd8017370cf7" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "cinder-quobyte-6b443a14-97ec-4547-9666-dd8017370cf7" acquired by "delete_volume" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74f2720-bacd-4718-87ac-dfb82e416e89]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:42 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e 1073741824" returned: 0 in 0.704s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:42 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 Sep 11 23:06:42 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:42 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e Sep 11 23:06:42 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:42 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:42 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7" returned: 0 in 0.660s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467cee39-2eb1-4ed1-b652-ee669968710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e5a5b0-22fc-4f96-bacf-b9310b1558c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:42 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7 Sep 11 23:06:42 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Volume volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e (f3e3a2ac-d60d-45e5-a5bb-a651cf72799e): created successfully Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e5a5b0-22fc-4f96-bacf-b9310b1558c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Flow 'volume_create_manager' (919cda7c-d6b6-4c48-9854-c2c092c764cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e643e5c8-39d5-4425-984d-917c66826456 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Created volume successfully. Sep 11 23:06:43 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6b443a14-97ec-4547-9666-dd8017370cf7" returned: 0 in 0.417s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "cinder-quobyte-6b443a14-97ec-4547-9666-dd8017370cf7" released by "delete_volume" :: held 1.152s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Created reservations ['305a18e1-3f91-44c8-83d2-ef621188e29d', '487cc7dc-ba53-48fd-8464-9c9599dd4696', '943185aa-ca62-41e9-9fdf-3c770c3e1778', '02484d5e-f14e-4d7d-a37a-4d085933b54c'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (2e986cf6-3b0c-4691-8e58-6f310252d6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3bb528-0d7f-4cd9-b555-441a3444af76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3bb528-0d7f-4cd9-b555-441a3444af76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1861536415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54d4eaf-79da-4434-ad2e-53f0e3b39928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:43Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc4a6be-8d92-4b8e-bb3e-eb91685df935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc4a6be-8d92-4b8e-bb3e-eb91685df935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e91b403-29f4-4bf1-80cf-ead806129694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e91b403-29f4-4bf1-80cf-ead806129694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54d4eaf-79da-4434-ad2e-53f0e3b39928', 'volume_name': 'volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b08e7e9-635c-4389-aaec-dd6ec567b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b08e7e9-635c-4389-aaec-dd6ec567b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb3f2eb-bb0f-4eed-a273-abbbd894b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Volume f54d4eaf-79da-4434-ad2e-53f0e3b39928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928', 'volume_size': 1} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1861536415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54d4eaf-79da-4434-ad2e-53f0e3b39928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:43Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Creating volume f54d4eaf-79da-4434-ad2e-53f0e3b39928 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:43 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:43 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 1073741824 Sep 11 23:06:43 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:43 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:43 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:43 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.360s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:43 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Deleted volume successfully. Sep 11 23:06:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6ccc25a0-6d91-4c56-bba3-2feb484350e7 tempest-AbsoluteLimitsTests-1400859853 None] Lock "cinder-6b443a14-97ec-4547-9666-dd8017370cf7-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:44 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 1073741824" returned: 0 in 0.646s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:44 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 Sep 11 23:06:44 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:44 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928" returned: 0 in 0.322s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.705s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb3f2eb-bb0f-4eed-a273-abbbd894b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15284e54-a887-475a-a890-35bd90df260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Creating offline snapshot cc0839b6-d1e4-4d0a-a7cd-01b836650e53 of volume f3e3a2ac-d60d-45e5-a5bb-a651cf72799e {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:06:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Volume volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 (f54d4eaf-79da-4434-ad2e-53f0e3b39928): created successfully Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15284e54-a887-475a-a890-35bd90df260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (2e986cf6-3b0c-4691-8e58-6f310252d6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c4d54-a0ac-48a4-bd28-9b022c10b1b9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4ea13d36-9484-4281-a2d6-0d5eaba61b11 tempest-VolumesActionsTest-265437828 None] Created volume successfully. Sep 11 23:06:44 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e Sep 11 23:06:44 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:44 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" returned: 0 in 0.414s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:44 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 1G Sep 11 23:06:44 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-440f7d3e-4f1c-4cac-80cb-638514415337 tempest-VolumesActionsTest-265437828 None] Acquiring lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928" by "attach_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-440f7d3e-4f1c-4cac-80cb-638514415337 tempest-VolumesActionsTest-265437828 None] Lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928" acquired by "attach_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:45 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 1G" returned: 0 in 0.560s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:45 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 Sep 11 23:06:45 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-440f7d3e-4f1c-4cac-80cb-638514415337 tempest-VolumesActionsTest-265437828 None] Attaching volume f54d4eaf-79da-4434-ad2e-53f0e3b39928 to instance cd511f47-67b0-4e86-84c0-87f68187f3f9 at mountpoint /dev/vdb on host None. Sep 11 23:06:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-440f7d3e-4f1c-4cac-80cb-638514415337 tempest-VolumesActionsTest-265437828 None] Attach volume completed successfully. Sep 11 23:06:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-440f7d3e-4f1c-4cac-80cb-638514415337 tempest-VolumesActionsTest-265437828 None] Lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928" released by "attach_volume" :: held 0.156s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:45 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53" returned: 0 in 0.421s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:45 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 is being set with open permissions: ugo+rw Sep 11 23:06:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:45 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 Sep 11 23:06:45 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:46 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53" returned: 0 in 0.403s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:46 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.info Sep 11 23:06:46 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:46 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0849d861-ad30-423e-88f7-634c506d1227 tempest-VolumesActionsTest-1724482076 None] Terminate volume connection completed successfully. Sep 11 23:06:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0849d861-ad30-423e-88f7-634c506d1227 tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-detach_volume" by "detach_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0849d861-ad30-423e-88f7-634c506d1227 tempest-VolumesActionsTest-1724482076 None] Lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:46 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0849d861-ad30-423e-88f7-634c506d1227 tempest-VolumesActionsTest-1724482076 None] Detaching volume f54d4eaf-79da-4434-ad2e-53f0e3b39928 from instance cd511f47-67b0-4e86-84c0-87f68187f3f9. Sep 11 23:06:46 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0849d861-ad30-423e-88f7-634c506d1227 tempest-VolumesActionsTest-1724482076 None] Detach volume completed successfully. Sep 11 23:06:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0849d861-ad30-423e-88f7-634c506d1227 tempest-VolumesActionsTest-1724482076 None] Lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:46 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.info" returned: 0 in 0.392s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:46 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.info is being set with open permissions: ugo+rw Sep 11 23:06:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:46 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.info Sep 11 23:06:46 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8af20352-ca3f-4471-8edc-77d5fd96ad7f tempest-VolumesActionsTest-265437828 None] Acquiring lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-detach_volume" by "detach_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8af20352-ca3f-4471-8edc-77d5fd96ad7f tempest-VolumesActionsTest-265437828 None] Lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8af20352-ca3f-4471-8edc-77d5fd96ad7f tempest-VolumesActionsTest-265437828 None] Volume detach called, but volume not attached. Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8af20352-ca3f-4471-8edc-77d5fd96ad7f tempest-VolumesActionsTest-265437828 None] Lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:47 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.info" returned: 0 in 0.386s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.726s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d835dc79-746f-423c-b9ae-1d3344d8b34d tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Create snapshot completed successfully Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Acquiring lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Acquiring lock "cinder-quobyte-f54d4eaf-79da-4434-ad2e-53f0e3b39928" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Lock "cinder-quobyte-f54d4eaf-79da-4434-ad2e-53f0e3b39928" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f935d47-0bab-4060-bcd0-9309bb0032e1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:47 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 Sep 11 23:06:47 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:47 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928" returned: 0 in 0.396s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:47 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928 Sep 11 23:06:47 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:48 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f54d4eaf-79da-4434-ad2e-53f0e3b39928" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Lock "cinder-quobyte-f54d4eaf-79da-4434-ad2e-53f0e3b39928" released by "delete_volume" :: held 0.850s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Created reservations ['f89c968d-8882-4d38-ba49-ebf2476864b1', '0b280502-81a2-48b8-bf38-079f6d036ce4', '8a050b1c-4a2d-4019-8342-42be5393d09d', '9247c7eb-4b81-4560-a0f8-8d25aae1ab79'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:48 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:48 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "cinder-cc0839b6-d1e4-4d0a-a7cd-01b836650e53-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-cc0839b6-d1e4-4d0a-a7cd-01b836650e53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "cinder-quobyte-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-quobyte-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "cinder-quobyte-cc0839b6-d1e4-4d0a-a7cd-01b836650e53" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-quobyte-cc0839b6-d1e4-4d0a-a7cd-01b836650e53" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Deleting offline snapshot cc0839b6-d1e4-4d0a-a7cd-01b836650e53 of volume f3e3a2ac-d60d-45e5-a5bb-a651cf72799e {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] snapshot_file for this snap is: volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57cfa68-aeef-4be6-b6f2-883e1d49625a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:48 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.400s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Deleted volume successfully. Sep 11 23:06:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2b664b97-48db-415c-b2d1-af0475c0bfcc tempest-VolumesActionsTest-265437828 None] Lock "cinder-f54d4eaf-79da-4434-ad2e-53f0e3b39928-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:49 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 Sep 11 23:06:49 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:49 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53" returned: 0 in 0.578s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:06:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92cb0ee-2b11-456f-be12-8489be939299]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:49 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e Sep 11 23:06:49 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:50 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" returned: 0 in 0.627s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:50 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 Sep 11 23:06:50 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:50 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53" returned: 0 in 0.580s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:50 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53 Sep 11 23:06:50 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:51 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e.cc0839b6-d1e4-4d0a-a7cd-01b836650e53" returned: 0 in 0.380s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-quobyte-cc0839b6-d1e4-4d0a-a7cd-01b836650e53" released by "_delete_snapshot" :: held 2.399s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-quobyte-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" released by "delete_snapshot" :: held 2.450s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Created reservations ['53abcc72-5d57-42cc-928c-76fe475f23a4', 'f296f5ec-21ac-408d-af2e-914aa8cc0053', '04e1eaa4-8bfa-4274-81d2-0cd36c53251b', '34544b3a-c3ba-4f81-a345-828861f548a1'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Delete snapshot completed successfully. Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ad9d14fe-ce28-46ba-a582-75dee6a5fcac tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-cc0839b6-d1e4-4d0a-a7cd-01b836650e53-delete_snapshot" released by "delete_snapshot" :: held 2.667s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Flow 'volume_create_manager' (4bd52a84-a27e-4656-956e-b77c83b4cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f127e73-3676-4038-ac9d-840cf4a172b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f127e73-3676-4038-ac9d-840cf4a172b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1941691604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ec0b62-f9d9-4a0d-986c-63b5c708af67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325b25a63e4847138cb07970484713ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:52Z,use_quota=True,user_id='8d8f25bc7afe482fa396304223c76d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9516e58-ddfb-4b76-b60b-3d79c548a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9516e58-ddfb-4b76-b60b-3d79c548a067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19ff361-4c3f-4233-82b8-dbf713edd036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19ff361-4c3f-4233-82b8-dbf713edd036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ec0b62-f9d9-4a0d-986c-63b5c708af67', 'volume_name': 'volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0ee578-c0f3-4cad-8403-a1cbbcab9f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0ee578-c0f3-4cad-8403-a1cbbcab9f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f0001f-2e60-4afb-84a1-3b618cef2ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:51 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Volume c4ec0b62-f9d9-4a0d-986c-63b5c708af67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67', 'volume_size': 1} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1941691604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ec0b62-f9d9-4a0d-986c-63b5c708af67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='325b25a63e4847138cb07970484713ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:52Z,use_quota=True,user_id='8d8f25bc7afe482fa396304223c76d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Creating volume c4ec0b62-f9d9-4a0d-986c-63b5c708af67 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:51 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:52 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 1073741824 Sep 11 23:06:52 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "cinder-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "cinder-quobyte-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-quobyte-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5535ce9f-3412-4aad-bbce-0aea8a0ce465]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:52 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e Sep 11 23:06:52 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (852ea59c-a5a5-4ff5-bfc3-0a88f818c9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114d54fc-44fb-4012-869f-929551b851d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114d54fc-44fb-4012-869f-929551b851d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858810181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfe7c10-30bb-4d6b-8515-10b6c7c78074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:52Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a94445-f84f-4844-93a5-9cd71374f950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a94445-f84f-4844-93a5-9cd71374f950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abad15e-418c-4c7a-b228-cee012d4f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abad15e-418c-4c7a-b228-cee012d4f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bfe7c10-30bb-4d6b-8515-10b6c7c78074', 'volume_name': 'volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a04070-c963-4361-8c61-92e3e53f7520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a04070-c963-4361-8c61-92e3e53f7520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e95dfd-4f55-417c-af9b-e00509b5f428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Volume 6bfe7c10-30bb-4d6b-8515-10b6c7c78074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074', 'volume_size': 1} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:52 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 1073741824" returned: 0 in 0.644s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:52 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 Sep 11 23:06:52 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:52 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" returned: 0 in 0.516s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:52 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e Sep 11 23:06:52 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Flow 'volume_create_manager' (d350f517-09c8-454a-9017-1ac0bb6a8353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1d5aa6-8bd5-4cb0-a073-92eee1a83031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1d5aa6-8bd5-4cb0-a073-92eee1a83031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-95797551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2053529-1caa-4f25-910e-b7a51aba76bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e4c26d1774effa5fe230487218fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:53Z,use_quota=True,user_id='249f71cf4e4c43af85b54007c30a2fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a101747a-c394-4cd7-89fb-8d181f45e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a101747a-c394-4cd7-89fb-8d181f45e00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90881323-029b-4c0e-bd4c-e2d4e6c5c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90881323-029b-4c0e-bd4c-e2d4e6c5c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2053529-1caa-4f25-910e-b7a51aba76bd', 'volume_name': 'volume-d2053529-1caa-4f25-910e-b7a51aba76bd', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba22665f-aa64-400d-a522-e83707096b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba22665f-aa64-400d-a522-e83707096b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93a0863-c3c2-44f8-9d48-17a5dd7d630e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Volume d2053529-1caa-4f25-910e-b7a51aba76bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2053529-1caa-4f25-910e-b7a51aba76bd', 'volume_size': 1} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:52 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67" returned: 0 in 0.270s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858810181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfe7c10-30bb-4d6b-8515-10b6c7c78074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:52Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Creating volume 6bfe7c10-30bb-4d6b-8515-10b6c7c78074 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:52 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f0001f-2e60-4afb-84a1-3b618cef2ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:52 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 1073741824 Sep 11 23:06:52 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4762daac-74dd-4116-99ac-0299e0c5ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Volume volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 (c4ec0b62-f9d9-4a0d-986c-63b5c708af67): created successfully Sep 11 23:06:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4762daac-74dd-4116-99ac-0299e0c5ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Flow 'volume_create_manager' (4bd52a84-a27e-4656-956e-b77c83b4cc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-465faad4-e013-4db9-832e-253144e5e1d5 tempest-VolumesMetadataTest-1673890194 None] Created volume successfully. Sep 11 23:06:53 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" returned: 0 in 0.298s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-quobyte-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e" released by "delete_volume" :: held 0.895s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Created reservations ['a7663d7b-e1d1-44f1-8a9a-89361ba6ae4d', 'f10b3b98-b82a-401e-b681-643a70e2c4e7', '463b414e-2aa2-4fb6-a558-9ee4c8f642b5', 'f0b1c79d-bfd8-461f-840a-15c384f9d188'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:53 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:53 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 1073741824" returned: 0 in 0.500s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:53 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.313s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Deleted volume successfully. Sep 11 23:06:53 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 Sep 11 23:06:53 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4ce818bb-6a58-4728-ae9d-9c0f140fe300 tempest-VolumeSnapshotQuotasNegativeTestJSON-2096878858 None] Lock "cinder-f3e3a2ac-d60d-45e5-a5bb-a651cf72799e-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:53 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074" returned: 0 in 0.294s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-95797551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2053529-1caa-4f25-910e-b7a51aba76bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e4c26d1774effa5fe230487218fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:53Z,use_quota=True,user_id='249f71cf4e4c43af85b54007c30a2fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Creating volume d2053529-1caa-4f25-910e-b7a51aba76bd {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:53 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:53 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd 1073741824 Sep 11 23:06:53 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e95dfd-4f55-417c-af9b-e00509b5f428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c38c47-ae6d-477c-9f3c-ea7feff890bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:53 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Volume volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 (6bfe7c10-30bb-4d6b-8515-10b6c7c78074): created successfully Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c38c47-ae6d-477c-9f3c-ea7feff890bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (852ea59c-a5a5-4ff5-bfc3-0a88f818c9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-db8837db-54f0-4152-ab07-3126e27028c9 tempest-VolumesActionsTest-265437828 None] Created volume successfully. Sep 11 23:06:54 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd 1073741824" returned: 0 in 0.537s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:54 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd Sep 11 23:06:54 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:54 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd" returned: 0 in 0.361s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93a0863-c3c2-44f8-9d48-17a5dd7d630e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2053529-1caa-4f25-910e-b7a51aba76bd', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25ead23-3a67-4ada-a078-186d18df6fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-6bfe7c10-30bb-4d6b-8515-10b6c7c78074-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:54 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Volume volume-d2053529-1caa-4f25-910e-b7a51aba76bd (d2053529-1caa-4f25-910e-b7a51aba76bd): created successfully Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25ead23-3a67-4ada-a078-186d18df6fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Flow 'volume_create_manager' (d350f517-09c8-454a-9017-1ac0bb6a8353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:54 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-bbbd4c9d-83a6-43cd-8007-a8530882ece6 tempest-AttachVolumeTestJSON-1441574395 None] Created volume successfully. Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Lock "cinder-6bfe7c10-30bb-4d6b-8515-10b6c7c78074-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-quobyte-6bfe7c10-30bb-4d6b-8515-10b6c7c78074" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Lock "cinder-quobyte-6bfe7c10-30bb-4d6b-8515-10b6c7c78074" acquired by "delete_volume" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58151ec7-cdc1-42f1-b1f9-e1e7f540efb5]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:55 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Acquiring lock "cinder-c4ec0b62-f9d9-4a0d-986c-63b5c708af67-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:55 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Lock "cinder-c4ec0b62-f9d9-4a0d-986c-63b5c708af67-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Acquiring lock "cinder-quobyte-c4ec0b62-f9d9-4a0d-986c-63b5c708af67" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Lock "cinder-quobyte-c4ec0b62-f9d9-4a0d-986c-63b5c708af67" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ae4975-ba89-4f0f-ba04-84797503f650]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:55 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 Sep 11 23:06:55 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:55 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074" returned: 0 in 0.454s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:55 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074 Sep 11 23:06:55 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:55 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67" returned: 0 in 0.433s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:55 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6bfe7c10-30bb-4d6b-8515-10b6c7c78074" returned: 0 in 0.288s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:55 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67 Sep 11 23:06:55 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Lock "cinder-quobyte-6bfe7c10-30bb-4d6b-8515-10b6c7c78074" released by "delete_volume" :: held 0.816s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Created reservations ['6b56ec41-737c-4193-a5dc-76367779b863', '9c644de3-753a-4b31-99a8-2f90ec756211', '7ce79a68-1c23-4a4f-9755-ca7e127f2fd7', 'ed4f551b-1c9a-4db7-a73f-8642b67e084f'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:56 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:56 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:56 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c4ec0b62-f9d9-4a0d-986c-63b5c708af67" returned: 0 in 0.354s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Lock "cinder-quobyte-c4ec0b62-f9d9-4a0d-986c-63b5c708af67" released by "delete_volume" :: held 0.844s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Created reservations ['49b62070-5549-44a1-99d9-edc2a97fdcf0', '265608e3-b7cc-4ae3-9842-b81bdcaaed47', '327551b0-ca42-4449-9f71-47fbdc97234a', '19e2b5da-ab83-48d2-a2f9-566f9f090687'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:56 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:06:56 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:56 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Deleted volume successfully. Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4cfd25b4-164d-4a8a-93ef-69946766b8cf tempest-VolumesActionsTest-1724482076 None] Lock "cinder-6bfe7c10-30bb-4d6b-8515-10b6c7c78074-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:06:56 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (39edfbc2-0273-44c4-9a63-487c0f14d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b629b0-0091-42b1-9b33-e4b9c33c737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.616s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:06:57 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Deleted volume successfully. Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b629b0-0091-42b1-9b33-e4b9c33c737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-300303348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cb19ee-a56e-4ddc-ab80-f9b20cd819f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:57Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00a5e95-99d6-414b-b52f-de72092de447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00a5e95-99d6-414b-b52f-de72092de447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa328c44-2825-4476-bc27-10baf9aa5786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa328c44-2825-4476-bc27-10baf9aa5786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29cb19ee-a56e-4ddc-ab80-f9b20cd819f6', 'volume_name': 'volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a67720-335c-4a33-a671-00d157b820f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a67720-335c-4a33-a671-00d157b820f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0d54f6-b487-4799-9f06-ceba85156577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:57 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Volume 29cb19ee-a56e-4ddc-ab80-f9b20cd819f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6', 'volume_size': 1} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-300303348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cb19ee-a56e-4ddc-ab80-f9b20cd819f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:57Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Creating volume 29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:06:57 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f84cddd3-aa16-4bcb-a622-dbf80f0cb8c0 tempest-VolumesMetadataTest-1673890194 None] Lock "cinder-c4ec0b62-f9d9-4a0d-986c-63b5c708af67-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:06:57 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 1073741824 Sep 11 23:06:57 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-487593b4-f91b-4e89-86b9-d5bd5bb014b7 req-a1bfa7a3-e967-4204-9b5f-ecf9f4773d32 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:06:57 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 1073741824" returned: 0 in 0.700s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:57 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 Sep 11 23:06:57 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:58 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6" returned: 0 in 0.294s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-487593b4-f91b-4e89-86b9-d5bd5bb014b7 req-a1bfa7a3-e967-4204-9b5f-ecf9f4773d32 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.485s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0d54f6-b487-4799-9f06-ceba85156577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4520e45-db7e-4b20-876d-3ffbd3cc53d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-487593b4-f91b-4e89-86b9-d5bd5bb014b7 req-a1bfa7a3-e967-4204-9b5f-ecf9f4773d32 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:06:58 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Volume volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 (29cb19ee-a56e-4ddc-ab80-f9b20cd819f6): created successfully Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4520e45-db7e-4b20-876d-3ffbd3cc53d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (39edfbc2-0273-44c4-9a63-487c0f14d030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:06:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2aaf00d6-806e-40f8-abb4-aee4abe9aeb5 tempest-VolumesActionsTest-265437828 None] Created volume successfully. Sep 11 23:06:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-487593b4-f91b-4e89-86b9-d5bd5bb014b7 req-a1bfa7a3-e967-4204-9b5f-ecf9f4773d32 tempest-AttachVolumeTestJSON-1441574395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-d2053529-1caa-4f25-910e-b7a51aba76bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be863f21-4d28-4918-9a81-861ae461ccb4', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:06:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-487593b4-f91b-4e89-86b9-d5bd5bb014b7 req-a1bfa7a3-e967-4204-9b5f-ecf9f4773d32 tempest-AttachVolumeTestJSON-1441574395 None] attachment_update completed successfully. Sep 11 23:06:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Lock "cinder-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-quobyte-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:06:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Lock "cinder-quobyte-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:06:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9b163-9b91-4351-90e1-68ffffd8f915]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:06:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:06:59 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 Sep 11 23:06:59 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:06:59 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 11 23:06:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6" returned: 0 in 0.491s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:06:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:00 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6 Sep 11 23:07:00 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:00 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6" returned: 0 in 0.319s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Lock "cinder-quobyte-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6" released by "delete_volume" :: held 0.885s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Created reservations ['dd45fc08-ed06-4f79-8219-7c119baab8a3', '55bc3d17-fbf0-471e-95c3-069930f7a8c2', '84d98054-f1b7-4729-b918-f53b526aa9a4', 'b321313f-e2ce-41e1-bd79-7707c97be81d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:00 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:00 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Flow 'volume_create_manager' (d5ba4aef-36d8-4beb-ad9e-80d5fd3a342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee96e0fd-18d3-4de3-80f4-d0e46e5d1c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee96e0fd-18d3-4de3-80f4-d0e46e5d1c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1326595637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5888a2-1b17-4dcf-94a1-a6944640b923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e4c26d1774effa5fe230487218fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:01Z,use_quota=True,user_id='249f71cf4e4c43af85b54007c30a2fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01ddd37-342d-47a4-8d15-4efa1e141dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01ddd37-342d-47a4-8d15-4efa1e141dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314e5674-dfa9-447e-b5bd-53dc7fe14a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314e5674-dfa9-447e-b5bd-53dc7fe14a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5888a2-1b17-4dcf-94a1-a6944640b923', 'volume_name': 'volume-dd5888a2-1b17-4dcf-94a1-a6944640b923', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d5c6cc-3dbe-439e-9e19-069cca5feea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d5c6cc-3dbe-439e-9e19-069cca5feea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4faea9-8849-470e-8444-870eb6225571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:00 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Volume dd5888a2-1b17-4dcf-94a1-a6944640b923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5888a2-1b17-4dcf-94a1-a6944640b923', 'volume_size': 1} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1326595637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5888a2-1b17-4dcf-94a1-a6944640b923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e4c26d1774effa5fe230487218fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:01Z,use_quota=True,user_id='249f71cf4e4c43af85b54007c30a2fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Creating volume dd5888a2-1b17-4dcf-94a1-a6944640b923 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:00 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:00 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 1073741824 Sep 11 23:07:00 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:00 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.317s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Deleted volume successfully. Sep 11 23:07:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6d6fa0d8-5985-403f-a3cf-d9f5b052f3cc tempest-VolumesActionsTest-1724482076 None] Lock "cinder-29cb19ee-a56e-4ddc-ab80-f9b20cd819f6-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:01 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (d60da3f6-d916-476c-b2ce-6a5d295b28fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c595415c-f541-4e93-8c52-59980a378ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 1073741824" returned: 0 in 0.608s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c595415c-f541-4e93-8c52-59980a378ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1801758565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b37f70-8d1f-431a-9540-3641ed1664b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:01Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c9d9f3-a89b-41f6-aa1f-bf9d8c86da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c9d9f3-a89b-41f6-aa1f-bf9d8c86da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b39b12-0441-4e79-a7a2-95e7542da8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b39b12-0441-4e79-a7a2-95e7542da8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b37f70-8d1f-431a-9540-3641ed1664b4', 'volume_name': 'volume-c0b37f70-8d1f-431a-9540-3641ed1664b4', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efe65f6-6c13-4e52-95f9-926bbccc1fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efe65f6-6c13-4e52-95f9-926bbccc1fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b50f8e5-0d5a-455a-96ab-126ff550514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:01 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Volume c0b37f70-8d1f-431a-9540-3641ed1664b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b37f70-8d1f-431a-9540-3641ed1664b4', 'volume_size': 1} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:01 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 Sep 11 23:07:01 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:01 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.300s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1801758565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b37f70-8d1f-431a-9540-3641ed1664b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:01Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Creating volume c0b37f70-8d1f-431a-9540-3641ed1664b4 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:01 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4faea9-8849-470e-8444-870eb6225571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5888a2-1b17-4dcf-94a1-a6944640b923', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:01 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 1073741824 Sep 11 23:07:01 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18921a64-1986-4d72-bd60-32155c7ad126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:01 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Volume volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 (dd5888a2-1b17-4dcf-94a1-a6944640b923): created successfully Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18921a64-1986-4d72-bd60-32155c7ad126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Flow 'volume_create_manager' (d5ba4aef-36d8-4beb-ad9e-80d5fd3a342e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4c41b4b9-5a49-4869-b37b-7d7904542ba9 tempest-AttachVolumeTestJSON-1441574395 None] Created volume successfully. Sep 11 23:07:02 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 1073741824" returned: 0 in 0.595s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:02 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 Sep 11 23:07:02 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Flow 'volume_create_manager' (6fcd2a6b-cc52-4a9c-a527-8e1283172550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757be3ed-d2c9-4430-9c4c-a08e04eb163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757be3ed-d2c9-4430-9c4c-a08e04eb163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-208969831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1646bab3-5c6a-49f6-99d9-4e6ef97d20af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3a69d80561495c8d41aca3606adbf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:03Z,use_quota=True,user_id='08a044e6c32d4bb58a8f843a894ad054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dd15c5-a90f-4eba-8e6c-e4138cb5f104),volume_type_id=96dd15c5-a90f-4eba-8e6c-e4138cb5f104)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0c3b76-cd39-4dff-b171-27ae2a5db330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0c3b76-cd39-4dff-b171-27ae2a5db330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817e2763-1ca7-4c67-916a-2c7d2630fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:02 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817e2763-1ca7-4c67-916a-2c7d2630fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1646bab3-5c6a-49f6-99d9-4e6ef97d20af', 'volume_name': 'volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6c7973-02c3-4b7e-86e8-de976309c20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6c7973-02c3-4b7e-86e8-de976309c20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5a32af-5fab-4567-9071-78a1905c1596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:02 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Volume 1646bab3-5c6a-49f6-99d9-4e6ef97d20af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af', 'volume_size': 1} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4" returned: 0 in 0.470s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-208969831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1646bab3-5c6a-49f6-99d9-4e6ef97d20af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3a69d80561495c8d41aca3606adbf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:03Z,use_quota=True,user_id='08a044e6c32d4bb58a8f843a894ad054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dd15c5-a90f-4eba-8e6c-e4138cb5f104),volume_type_id=96dd15c5-a90f-4eba-8e6c-e4138cb5f104)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Creating volume 1646bab3-5c6a-49f6-99d9-4e6ef97d20af {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:02 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:02 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af 1073741824 Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b50f8e5-0d5a-455a-96ab-126ff550514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b37f70-8d1f-431a-9540-3641ed1664b4', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:02 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313afd73-b69c-4c51-af26-c9e8552b238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:02 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Volume volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 (c0b37f70-8d1f-431a-9540-3641ed1664b4): created successfully Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313afd73-b69c-4c51-af26-c9e8552b238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (d60da3f6-d916-476c-b2ce-6a5d295b28fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-9e5da884-420c-400c-a99b-1817537a3104 tempest-VolumesActionsTest-265437828 None] Created volume successfully. Sep 11 23:07:03 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af 1073741824" returned: 0 in 0.546s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:03 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af Sep 11 23:07:03 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:03 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af" returned: 0 in 0.302s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5a32af-5fab-4567-9071-78a1905c1596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee308d41-f791-4caa-b2c8-9523f4700b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-c0b37f70-8d1f-431a-9540-3641ed1664b4-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=99,cinder:UPDATE=137,cinder:INSERT=36,cinder:DELETE=10 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:07:03 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Volume volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af (1646bab3-5c6a-49f6-99d9-4e6ef97d20af): created successfully Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee308d41-f791-4caa-b2c8-9523f4700b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Flow 'volume_create_manager' (6fcd2a6b-cc52-4a9c-a527-8e1283172550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Lock "cinder-c0b37f70-8d1f-431a-9540-3641ed1664b4-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-29a46c73-be42-4bde-aaff-b2103f4715ef tempest-VolumeTypesAccessTest-2082533374 None] Created volume successfully. Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-quobyte-c0b37f70-8d1f-431a-9540-3641ed1664b4" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Lock "cinder-quobyte-c0b37f70-8d1f-431a-9540-3641ed1664b4" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc1e34-ce66-4a71-b359-5c35ddf7be3d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-9668ce55-31c3-482b-a04c-8058fd560bba req-f9332bc0-ee99-45e8-8399-c56986c0d0c2 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-9668ce55-31c3-482b-a04c-8058fd560bba req-f9332bc0-ee99-45e8-8399-c56986c0d0c2 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Flow 'volume_create_manager' (1a0ee0e2-cad0-474e-b931-852ce2707bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb56746-c4b2-463b-9da8-77373a6f6a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-9668ce55-31c3-482b-a04c-8058fd560bba req-f9332bc0-ee99-45e8-8399-c56986c0d0c2 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb56746-c4b2-463b-9da8-77373a6f6a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1703234930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d06036-8f7e-48e1-b29e-9a326de07701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22654ccfb0e4f39ae37618002d923cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:04Z,use_quota=True,user_id='3859e35957bb46d6a86b77565f071f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecec250d-16b8-4ee4-849c-fa6a209b6bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecec250d-16b8-4ee4-849c-fa6a209b6bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7d008a-9430-4ae5-b242-38c793855e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7d008a-9430-4ae5-b242-38c793855e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d06036-8f7e-48e1-b29e-9a326de07701', 'volume_name': 'volume-92d06036-8f7e-48e1-b29e-9a326de07701', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505a2c9d-c88e-497b-a18f-9a093da468cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:04 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 Sep 11 23:07:04 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505a2c9d-c88e-497b-a18f-9a093da468cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748ec18f-0f44-446c-8e63-a093a59a3278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:04 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Volume 92d06036-8f7e-48e1-b29e-9a326de07701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d06036-8f7e-48e1-b29e-9a326de07701', 'volume_size': 1} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1703234930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d06036-8f7e-48e1-b29e-9a326de07701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22654ccfb0e4f39ae37618002d923cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:04Z,use_quota=True,user_id='3859e35957bb46d6a86b77565f071f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Creating volume 92d06036-8f7e-48e1-b29e-9a326de07701 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:04 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:04 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 1073741824 Sep 11 23:07:04 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-9668ce55-31c3-482b-a04c-8058fd560bba req-f9332bc0-ee99-45e8-8399-c56986c0d0c2 tempest-AttachVolumeTestJSON-1441574395 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-dd5888a2-1b17-4dcf-94a1-a6944640b923', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d404557-e9ff-4a5f-9020-af43bf349879', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:07:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-9668ce55-31c3-482b-a04c-8058fd560bba req-f9332bc0-ee99-45e8-8399-c56986c0d0c2 tempest-AttachVolumeTestJSON-1441574395 None] attachment_update completed successfully. Sep 11 23:07:04 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4" returned: 0 in 0.417s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:04 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4 Sep 11 23:07:04 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:04 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 1073741824" returned: 0 in 0.560s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:04 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c0b37f70-8d1f-431a-9540-3641ed1664b4" returned: 0 in 0.347s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Lock "cinder-quobyte-c0b37f70-8d1f-431a-9540-3641ed1664b4" released by "delete_volume" :: held 0.830s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:04 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 Sep 11 23:07:04 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Created reservations ['ecc4756e-0146-4bd1-a876-60e722fdc1dd', '9634504a-695f-4b1d-b14c-3bb031189a39', '3729f753-ee6f-4e20-b3e4-4e36f492e000', 'af99e21c-9645-4ec6-a5d1-61eda592d1b7'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Acquiring lock "cinder-1646bab3-5c6a-49f6-99d9-4e6ef97d20af-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Lock "cinder-1646bab3-5c6a-49f6-99d9-4e6ef97d20af-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Acquiring lock "cinder-quobyte-1646bab3-5c6a-49f6-99d9-4e6ef97d20af" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Lock "cinder-quobyte-1646bab3-5c6a-49f6-99d9-4e6ef97d20af" acquired by "delete_volume" :: waited 0.044s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:05 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:05 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:05 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701" returned: 0 in 0.365s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[46183c19-9b80-4423-9a34-56e70e7305ef]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748ec18f-0f44-446c-8e63-a093a59a3278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d06036-8f7e-48e1-b29e-9a326de07701', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b202d78d-751b-45b5-8d59-9a325939ad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:05 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Volume volume-92d06036-8f7e-48e1-b29e-9a326de07701 (92d06036-8f7e-48e1-b29e-9a326de07701): created successfully Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b202d78d-751b-45b5-8d59-9a325939ad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Flow 'volume_create_manager' (1a0ee0e2-cad0-474e-b931-852ce2707bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:05 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2f3b03d5-2dc9-4d5d-830f-97a630b932e6 tempest-VolumesTransfersTest-1550448816 None] Created volume successfully. Sep 11 23:07:05 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af Sep 11 23:07:05 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:05 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.296s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:05 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Deleted volume successfully. Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29468b0a-3b24-4724-bd77-f478fbc54a02 tempest-VolumesActionsTest-1724482076 None] Lock "cinder-c0b37f70-8d1f-431a-9540-3641ed1664b4-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:05 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af" returned: 0 in 0.411s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:05 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af Sep 11 23:07:05 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:05 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-1646bab3-5c6a-49f6-99d9-4e6ef97d20af" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Lock "cinder-quobyte-1646bab3-5c6a-49f6-99d9-4e6ef97d20af" released by "delete_volume" :: held 0.730s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:06 devstack cinder-volume[88026]: WARNING cinder.quota [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-616496267 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-616496267, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:06 devstack cinder-volume[88026]: WARNING cinder.quota [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-616496267 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-616496267, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Created reservations ['c9c2dab1-2acb-446f-8c8f-c77150da6d8f', '88199473-9efb-4f27-acc2-f9ca8a609481', '24719401-c8c9-4b77-ac27-58c20ca1c3f0', '6301e3d1-94a5-4212-80fd-4e3f402107f0'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:06 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:06 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:06 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.288s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Deleted volume successfully. Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39b3de68-4e3c-49fc-a71d-6ba00d89d18a tempest-VolumeTypesAccessTest-2082533374 None] Lock "cinder-1646bab3-5c6a-49f6-99d9-4e6ef97d20af-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (1ec7a3a9-081f-430e-a322-30e762103cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897ab46e-ce7c-4da0-98fb-06f7d1bce000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897ab46e-ce7c-4da0-98fb-06f7d1bce000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1542072663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faec2a27-413b-4365-bcb6-8aba0b9aa586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:07Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e39ca88-30de-4b73-b66d-225d6e1db9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e39ca88-30de-4b73-b66d-225d6e1db9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2a3925-7cfa-472f-b971-a85e4253f196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2a3925-7cfa-472f-b971-a85e4253f196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faec2a27-413b-4365-bcb6-8aba0b9aa586', 'volume_name': 'volume-faec2a27-413b-4365-bcb6-8aba0b9aa586', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c12e9d7-12f6-4a69-b5fd-9c3881d4cbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c12e9d7-12f6-4a69-b5fd-9c3881d4cbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27e08dc-2bc7-466b-959d-90e4fe7602de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:06 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Volume faec2a27-413b-4365-bcb6-8aba0b9aa586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faec2a27-413b-4365-bcb6-8aba0b9aa586', 'volume_size': 1} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1542072663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faec2a27-413b-4365-bcb6-8aba0b9aa586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:07Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Creating volume faec2a27-413b-4365-bcb6-8aba0b9aa586 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:06 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:07 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 1073741824 Sep 11 23:07:07 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:07 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-1608ea0b-ce2e-4573-ae61-318b9f3f304d req-b6f70e9a-d4ed-4972-ae72-96ab57c90cbe tempest-AttachVolumeTestJSON-1441574395 None] Terminate volume connection completed successfully. Sep 11 23:07:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-1608ea0b-ce2e-4573-ae61-318b9f3f304d req-b6f70e9a-d4ed-4972-ae72-96ab57c90cbe tempest-AttachVolumeTestJSON-1441574395 None] Deleting attachment be863f21-4d28-4918-9a81-861ae461ccb4. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:07:07 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b28ed45a-4e7b-4caa-8def-b62c5ddc0615 tempest-VolumesTransfersTest-1979858906 None] Transfer volume completed successfully. Sep 11 23:07:07 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 1073741824" returned: 0 in 0.624s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:07 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 Sep 11 23:07:07 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:07 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586" returned: 0 in 0.345s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27e08dc-2bc7-466b-959d-90e4fe7602de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faec2a27-413b-4365-bcb6-8aba0b9aa586', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106c5006-3554-48b2-9ba6-f220b30a5a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:08 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Volume volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 (faec2a27-413b-4365-bcb6-8aba0b9aa586): created successfully Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106c5006-3554-48b2-9ba6-f220b30a5a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (1ec7a3a9-081f-430e-a322-30e762103cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:08 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5d134aaf-5e02-4b90-8b67-e0d798c3aced tempest-VolumesActionsTest-265437828 None] Created volume successfully. Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Acquiring lock "cinder-92d06036-8f7e-48e1-b29e-9a326de07701-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Lock "cinder-92d06036-8f7e-48e1-b29e-9a326de07701-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Acquiring lock "cinder-quobyte-92d06036-8f7e-48e1-b29e-9a326de07701" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Lock "cinder-quobyte-92d06036-8f7e-48e1-b29e-9a326de07701" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcff204-4fad-4cfc-aba7-8849627e4106]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:08 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-c59dbdb3-0e19-42f3-8f19-8207a342f6b2 req-7148e845-013a-43d5-886a-be2c3ae0b5d8 tempest-AttachVolumeTestJSON-1441574395 None] Terminate volume connection completed successfully. Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-c59dbdb3-0e19-42f3-8f19-8207a342f6b2 req-7148e845-013a-43d5-886a-be2c3ae0b5d8 tempest-AttachVolumeTestJSON-1441574395 None] Deleting attachment 6d404557-e9ff-4a5f-9020-af43bf349879. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:07:08 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 Sep 11 23:07:08 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:08 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:08 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701 Sep 11 23:07:08 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-92d06036-8f7e-48e1-b29e-9a326de07701" returned: 0 in 0.322s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-faec2a27-413b-4365-bcb6-8aba0b9aa586-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Lock "cinder-quobyte-92d06036-8f7e-48e1-b29e-9a326de07701" released by "delete_volume" :: held 0.829s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Lock "cinder-faec2a27-413b-4365-bcb6-8aba0b9aa586-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Acquiring lock "cinder-quobyte-faec2a27-413b-4365-bcb6-8aba0b9aa586" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Created reservations ['60c2e1e7-a0c7-4d7d-8053-cea5ecbc9c54', 'e2abf0dc-462a-4a75-a84b-b8761a193d5f', 'a77ba2df-2a3e-44cc-a748-a22ad86f4fea', '751f9f31-8b3e-48cd-a62f-f9d746abfa1a'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Lock "cinder-quobyte-faec2a27-413b-4365-bcb6-8aba0b9aa586" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b73084-a437-42f0-9ad7-5ae5478ca810]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 Sep 11 23:07:09 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:09 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.425s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:09 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586" returned: 0 in 0.567s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Deleted volume successfully. Sep 11 23:07:09 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586 Sep 11 23:07:09 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c4f1c1b7-5413-4c31-b00c-653d8a19a254 tempest-VolumesTransfersTest-23554803 None] Lock "cinder-92d06036-8f7e-48e1-b29e-9a326de07701-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:10 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Flow 'volume_create_manager' (b25b43e3-5e6e-446c-bc8e-1919044679bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f103eb03-6e67-4724-8675-c87e9db7d8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-faec2a27-413b-4365-bcb6-8aba0b9aa586" returned: 0 in 0.512s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f103eb03-6e67-4724-8675-c87e9db7d8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2084702255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f423037a-9688-4cfe-9857-3dc4772e7b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22654ccfb0e4f39ae37618002d923cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:10Z,use_quota=True,user_id='3859e35957bb46d6a86b77565f071f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5504639-f939-4bf6-a917-18b4818196ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5504639-f939-4bf6-a917-18b4818196ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77098cb-5677-4aa6-aa82-d2a823f6f811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77098cb-5677-4aa6-aa82-d2a823f6f811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f423037a-9688-4cfe-9857-3dc4772e7b56', 'volume_name': 'volume-f423037a-9688-4cfe-9857-3dc4772e7b56', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7771425e-c2f9-4e2f-9c68-9ee966b73a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7771425e-c2f9-4e2f-9c68-9ee966b73a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2ef93d-f1b6-4be6-b997-033474662f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:10 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Volume f423037a-9688-4cfe-9857-3dc4772e7b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f423037a-9688-4cfe-9857-3dc4772e7b56', 'volume_size': 1} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2084702255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f423037a-9688-4cfe-9857-3dc4772e7b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22654ccfb0e4f39ae37618002d923cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:10Z,use_quota=True,user_id='3859e35957bb46d6a86b77565f071f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Creating volume f423037a-9688-4cfe-9857-3dc4772e7b56 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:10 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Lock "cinder-quobyte-faec2a27-413b-4365-bcb6-8aba0b9aa586" released by "delete_volume" :: held 1.279s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:10 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 1073741824 Sep 11 23:07:10 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Created reservations ['518f45b3-1b6c-4406-8299-7361c1cb2c7b', '95baa2f7-c106-4547-95ed-58ca1e1812f4', 'b7a15049-fc28-408e-b157-25457e5c8bd8', '304621a6-bfe7-46e6-b979-28966369c6a1'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:10 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:10 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.315s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 1073741824" returned: 0 in 0.630s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Deleted volume successfully. Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-226f65ec-ad10-44a8-b8c9-ed5324df912a tempest-VolumesActionsTest-1724482076 None] Lock "cinder-faec2a27-413b-4365-bcb6-8aba0b9aa586-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:11 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 Sep 11 23:07:11 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:11 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:11 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:11 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56" returned: 0 in 0.332s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2ef93d-f1b6-4be6-b997-033474662f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f423037a-9688-4cfe-9857-3dc4772e7b56', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ef537c-8262-42e1-ba6d-5964a6aeb90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:11 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Volume volume-f423037a-9688-4cfe-9857-3dc4772e7b56 (f423037a-9688-4cfe-9857-3dc4772e7b56): created successfully Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ef537c-8262-42e1-ba6d-5964a6aeb90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Flow 'volume_create_manager' (b25b43e3-5e6e-446c-bc8e-1919044679bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:11 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-64e9bae2-a54a-4e37-89e1-f1f112f732c5 tempest-VolumesTransfersTest-1550448816 None] Created volume successfully. Sep 11 23:07:11 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.399s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:07:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (6fee62fa-0acb-4dff-b162-0d7f6edf1e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5f5096-5b3f-4b13-94b9-c4d26eb1255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5f5096-5b3f-4b13-94b9-c4d26eb1255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-371503582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dfc25f-ddb9-487b-9991-b0cd99afcccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:12Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1095e62b-72d4-48d0-8d8e-fe3d8d993fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1095e62b-72d4-48d0-8d8e-fe3d8d993fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de936d7-3ea7-4328-b055-a32636f5f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de936d7-3ea7-4328-b055-a32636f5f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53dfc25f-ddb9-487b-9991-b0cd99afcccb', 'volume_name': 'volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f3be18-7bf8-422e-9772-5add1d75b232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f3be18-7bf8-422e-9772-5add1d75b232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64811e9f-8fec-49fa-95e0-486c65a5b971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:12 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Volume 53dfc25f-ddb9-487b-9991-b0cd99afcccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb', 'volume_size': 1} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-371503582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dfc25f-ddb9-487b-9991-b0cd99afcccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e1d18743994439843abad16833d1d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:12Z,use_quota=True,user_id='2a47aea0eac44800aae722dad57526a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Creating volume 53dfc25f-ddb9-487b-9991-b0cd99afcccb {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:12 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:12 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb 1073741824 Sep 11 23:07:12 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Acquiring lock "cinder-f423037a-9688-4cfe-9857-3dc4772e7b56-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Lock "cinder-f423037a-9688-4cfe-9857-3dc4772e7b56-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Acquiring lock "cinder-quobyte-f423037a-9688-4cfe-9857-3dc4772e7b56" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Lock "cinder-quobyte-f423037a-9688-4cfe-9857-3dc4772e7b56" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb12bc4-8976-4a64-8804-8dff3d098d3a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:13 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb 1073741824" returned: 0 in 0.660s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:13 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb Sep 11 23:07:13 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:13 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 Sep 11 23:07:13 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:13 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56" returned: 0 in 0.475s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:13 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb" returned: 0 in 0.365s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64811e9f-8fec-49fa-95e0-486c65a5b971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:13 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56 Sep 11 23:07:13 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8f3728-7901-4a60-836f-e17b88597eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Volume volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb (53dfc25f-ddb9-487b-9991-b0cd99afcccb): created successfully Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8f3728-7901-4a60-836f-e17b88597eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Flow 'volume_create_manager' (6fee62fa-0acb-4dff-b162-0d7f6edf1e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:13 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6dba3410-1499-4399-b2a8-a00d605cf9d0 tempest-VolumesActionsTest-265437828 None] Created volume successfully. Sep 11 23:07:13 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f423037a-9688-4cfe-9857-3dc4772e7b56" returned: 0 in 0.260s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Lock "cinder-quobyte-f423037a-9688-4cfe-9857-3dc4772e7b56" released by "delete_volume" :: held 0.799s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Created reservations ['eccddf09-be44-4423-8949-1465417bf78f', '7ca3a287-dcff-4918-bf57-a90891749505', '765499d2-4505-456e-86d8-effec6a2918e', '1f4d9338-e7d5-4304-9325-99fb4fa7d83d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:13 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:13 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:14 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.417s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:14 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Deleted volume successfully. Sep 11 23:07:14 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06293b97-6daf-42f8-a994-804ec399a6e8 tempest-VolumesTransfersTest-23554803 None] Lock "cinder-f423037a-9688-4cfe-9857-3dc4772e7b56-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "cinder-dd5888a2-1b17-4dcf-94a1-a6944640b923-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-dd5888a2-1b17-4dcf-94a1-a6944640b923-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "cinder-quobyte-dd5888a2-1b17-4dcf-94a1-a6944640b923" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-quobyte-dd5888a2-1b17-4dcf-94a1-a6944640b923" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Acquiring lock "cinder-53dfc25f-ddb9-487b-9991-b0cd99afcccb-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16347ca2-9d57-4365-bd3a-6079fd16f247]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Lock "cinder-53dfc25f-ddb9-487b-9991-b0cd99afcccb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Acquiring lock "cinder-quobyte-53dfc25f-ddb9-487b-9991-b0cd99afcccb" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Lock "cinder-quobyte-53dfc25f-ddb9-487b-9991-b0cd99afcccb" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c36689-7de0-40bb-a633-5f744b578ff0]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:15 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 Sep 11 23:07:15 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:15 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb Sep 11 23:07:15 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:15 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923" returned: 0 in 0.469s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:15 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923 Sep 11 23:07:15 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:15 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb" returned: 0 in 0.477s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:15 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb Sep 11 23:07:15 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dd5888a2-1b17-4dcf-94a1-a6944640b923" returned: 0 in 0.358s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-quobyte-dd5888a2-1b17-4dcf-94a1-a6944640b923" released by "delete_volume" :: held 0.907s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Created reservations ['62dd0669-a4f2-4e1b-b4bc-000f8cb33c0c', 'cb8916af-a594-4fbc-893e-864bc488868e', 'f57086f6-a6f4-4034-9f35-1ac5cc650bda', '1b7056aa-aff4-4ba7-a799-effd603de85e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:16 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53dfc25f-ddb9-487b-9991-b0cd99afcccb" returned: 0 in 0.360s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Lock "cinder-quobyte-53dfc25f-ddb9-487b-9991-b0cd99afcccb" released by "delete_volume" :: held 0.888s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Created reservations ['0dfd22a1-8eec-4ef7-8399-27128e54af72', '4d4a5fb3-fbcf-4fa1-816b-b8c40583b2d9', '5fc70a0a-bfd8-49d5-b9b6-38cae4f1d06e', '8aa4415d-269c-47d0-a65b-9e4c6014281c'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:16 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:16 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "cinder-d2053529-1caa-4f25-910e-b7a51aba76bd-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-d2053529-1caa-4f25-910e-b7a51aba76bd-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:16 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:16 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "cinder-quobyte-d2053529-1caa-4f25-910e-b7a51aba76bd" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-quobyte-d2053529-1caa-4f25-910e-b7a51aba76bd" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:16 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.359s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Deleted volume successfully. Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12fc4bc-39b7-4813-b801-e1a277b56432]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ddc3614b-7d89-4189-bd2a-49f2d3a5c162 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-dd5888a2-1b17-4dcf-94a1-a6944640b923-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:16 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd Sep 11 23:07:16 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:16 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.337s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Deleted volume successfully. Sep 11 23:07:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a866ba3f-433a-4cc6-ab8b-2e5fcb9b6aab tempest-VolumesActionsTest-265437828 None] Lock "cinder-53dfc25f-ddb9-487b-9991-b0cd99afcccb-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:17 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd" returned: 0 in 0.450s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:17 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd Sep 11 23:07:17 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:17 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2053529-1caa-4f25-910e-b7a51aba76bd" returned: 0 in 0.268s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-quobyte-d2053529-1caa-4f25-910e-b7a51aba76bd" released by "delete_volume" :: held 0.805s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Created reservations ['a7d9a5b2-44fd-480c-a9af-96f056be8166', 'c78e87eb-c9c7-4ba9-85ce-70d8fc9a8f72', 'd60f3fc3-425b-49f9-a5cb-735d21054dc7', '68f7c97b-dde8-46e0-93d3-06873d3c3ccf'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:17 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:17 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:18 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.325s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:18 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Deleted volume successfully. Sep 11 23:07:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e4f82d04-e391-4182-bd87-b914052c5de9 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-d2053529-1caa-4f25-910e-b7a51aba76bd-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "cinder-085c5cf0-2ba8-488e-9e5e-a68497eead19-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-085c5cf0-2ba8-488e-9e5e-a68497eead19-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "cinder-quobyte-085c5cf0-2ba8-488e-9e5e-a68497eead19" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-quobyte-085c5cf0-2ba8-488e-9e5e-a68497eead19" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64d7d59-a134-4b0e-81ec-47b876b54c2d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:19 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 Sep 11 23:07:19 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:19 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19" returned: 0 in 0.524s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:19 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19 Sep 11 23:07:19 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:20 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-085c5cf0-2ba8-488e-9e5e-a68497eead19" returned: 0 in 0.335s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-quobyte-085c5cf0-2ba8-488e-9e5e-a68497eead19" released by "delete_volume" :: held 0.948s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Created reservations ['1d354cec-07ec-47f2-9fb3-4291f245154e', '22167c4c-2fd6-4028-b221-00274626d98c', '5a864d61-f92c-4ee7-ab3e-347ce69098ee', '9e7b3cf0-5351-4aab-8af4-9b476d29ae6e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:20 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:20 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:20 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.349s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Deleted volume successfully. Sep 11 23:07:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3dea1104-a5bf-4459-ab1d-56151c886118 tempest-AttachVolumeTestJSON-1441574395 None] Lock "cinder-085c5cf0-2ba8-488e-9e5e-a68497eead19-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:21 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Flow 'volume_create_manager' (e2833789-4633-4507-97fb-a9e0f6127c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d566c55-37e4-4c2a-8aac-d3b43c3daee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d566c55-37e4-4c2a-8aac-d3b43c3daee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-746790764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2414cb34-f061-430b-81bf-abad00e1f44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe8bf11f1743549911937b00a6183e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:22Z,use_quota=True,user_id='54d1a6b4e40f479c87d9c5323f441b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d07754f-8abf-43b4-9d67-0dded03f1d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d07754f-8abf-43b4-9d67-0dded03f1d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4156cc-a395-4b80-90e8-7b33e4ca25b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4156cc-a395-4b80-90e8-7b33e4ca25b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2414cb34-f061-430b-81bf-abad00e1f44a', 'volume_name': 'volume-2414cb34-f061-430b-81bf-abad00e1f44a', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d85f7b-a095-4317-a256-b49d1dcf7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d85f7b-a095-4317-a256-b49d1dcf7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b0ea7e-15bf-48af-ba68-e40bb5f8f592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:22 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Volume 2414cb34-f061-430b-81bf-abad00e1f44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2414cb34-f061-430b-81bf-abad00e1f44a', 'volume_size': 1} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-746790764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2414cb34-f061-430b-81bf-abad00e1f44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe8bf11f1743549911937b00a6183e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:22Z,use_quota=True,user_id='54d1a6b4e40f479c87d9c5323f441b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Creating volume 2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:22 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:22 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a 1073741824 Sep 11 23:07:22 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:22 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a 1073741824" returned: 0 in 0.757s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:22 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a Sep 11 23:07:22 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:23 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a" returned: 0 in 0.408s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b0ea7e-15bf-48af-ba68-e40bb5f8f592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2414cb34-f061-430b-81bf-abad00e1f44a', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6f4cd5-51d9-4c2c-9262-525262612959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:23 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Volume volume-2414cb34-f061-430b-81bf-abad00e1f44a (2414cb34-f061-430b-81bf-abad00e1f44a): created successfully Sep 11 23:07:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6f4cd5-51d9-4c2c-9262-525262612959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Flow 'volume_create_manager' (e2833789-4633-4507-97fb-a9e0f6127c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:23 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d5841f3b-9dac-43d4-8800-b61e3c968432 tempest-VolumesDeleteCascade-1565356369 None] Created volume successfully. Sep 11 23:07:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Creating offline snapshot 78175b23-4ad6-4e7d-a05f-ea6ce00954be of volume 2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:24 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa8668c-c2a9-4f22-abb7-c69487cd04e6]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:24 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a Sep 11 23:07:24 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:24 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a" returned: 0 in 0.556s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:24 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be 1G Sep 11 23:07:24 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:25 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be 1G" returned: 0 in 0.584s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:25 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be Sep 11 23:07:25 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Flow 'volume_create_manager' (7217a452-d38e-429a-8165-146e4b95d450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e07df7-46fa-463e-9e94-62111093eb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e07df7-46fa-463e-9e94-62111093eb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1162365410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e538241-441f-42c5-bb5d-36b2098898a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f209ff42349caa533a390fe543b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:25Z,use_quota=True,user_id='17eb083cdb7145028be7139527f50765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2ab9dc-d8d2-46c0-8afc-6f08ae02d216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2ab9dc-d8d2-46c0-8afc-6f08ae02d216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c908911c-033e-48e3-81d0-14af4cef0a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c908911c-033e-48e3-81d0-14af4cef0a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e538241-441f-42c5-bb5d-36b2098898a9', 'volume_name': 'volume-2e538241-441f-42c5-bb5d-36b2098898a9', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6542c91f-0ba7-4f6e-be89-1d8ebebd81b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6542c91f-0ba7-4f6e-be89-1d8ebebd81b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac8b239-3788-416e-ad84-49fc22807949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:25 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Volume 2e538241-441f-42c5-bb5d-36b2098898a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e538241-441f-42c5-bb5d-36b2098898a9', 'volume_size': 1} Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:25 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be" returned: 0 in 0.416s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:25 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be is being set with open permissions: ugo+rw Sep 11 23:07:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:25 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be Sep 11 23:07:25 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:26 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:26 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.info Sep 11 23:07:26 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:26 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.info" returned: 0 in 0.344s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:26 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.info is being set with open permissions: ugo+rw Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:26 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.info Sep 11 23:07:26 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:26 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.info" returned: 0 in 0.332s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.352s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1162365410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e538241-441f-42c5-bb5d-36b2098898a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f209ff42349caa533a390fe543b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:25Z,use_quota=True,user_id='17eb083cdb7145028be7139527f50765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Creating volume 2e538241-441f-42c5-bb5d-36b2098898a9 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:27 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:27 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 1073741824 Sep 11 23:07:27 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:27 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0a8b13db-6c87-488f-ad1c-88d9a1a9c26c tempest-VolumesDeleteCascade-1565356369 None] Create snapshot completed successfully Sep 11 23:07:27 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 1073741824" returned: 0 in 0.726s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:27 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 Sep 11 23:07:27 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:28 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.298s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Creating offline snapshot c8d87ab9-38db-4883-bd69-56522761a37f of volume 2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac8b239-3788-416e-ad84-49fc22807949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e538241-441f-42c5-bb5d-36b2098898a9', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9dec0a-eb22-48ef-9e2b-995c05cc7f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf2110a-4f23-45fc-81f7-637d568efe00]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:28 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Volume volume-2e538241-441f-42c5-bb5d-36b2098898a9 (2e538241-441f-42c5-bb5d-36b2098898a9): created successfully Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9dec0a-eb22-48ef-9e2b-995c05cc7f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Flow 'volume_create_manager' (7217a452-d38e-429a-8165-146e4b95d450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:28 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-754727ef-18d1-4994-92a9-f0f955549f23 tempest-VolumesTransfersV357Test-1686490782 None] Created volume successfully. Sep 11 23:07:28 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be Sep 11 23:07:28 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:28 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be" returned: 0 in 0.544s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2414cb34-f061-430b-81bf-abad00e1f44a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:28 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f 1G Sep 11 23:07:28 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:29 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f 1G" returned: 0 in 0.687s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:29 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f Sep 11 23:07:29 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:29 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f" returned: 0 in 0.402s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:29 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f is being set with open permissions: ugo+rw Sep 11 23:07:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:29 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f Sep 11 23:07:29 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7b3fb6f8-bea5-4cd0-8a41-a6fde576a943 tempest-VolumesTransfersV357Test-553924708 None] Transfer volume completed successfully. Sep 11 23:07:30 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f" returned: 0 in 0.372s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6e32cd24-67f6-41a0-986b-d336c2caf1c7 tempest-VolumesDeleteCascade-1565356369 None] Create snapshot completed successfully Sep 11 23:07:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Acquiring lock "cinder-2e538241-441f-42c5-bb5d-36b2098898a9-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Lock "cinder-2e538241-441f-42c5-bb5d-36b2098898a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-2414cb34-f061-430b-81bf-abad00e1f44a-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-2414cb34-f061-430b-81bf-abad00e1f44a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Acquiring lock "cinder-quobyte-2e538241-441f-42c5-bb5d-36b2098898a9" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Lock "cinder-quobyte-2e538241-441f-42c5-bb5d-36b2098898a9" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[47177762-792b-451d-aad1-26ad7480d633]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Performing cascade delete. {{(pid=88026) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-78175b23-4ad6-4e7d-a05f-ea6ce00954be-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-78175b23-4ad6-4e7d-a05f-ea6ce00954be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-78175b23-4ad6-4e7d-a05f-ea6ce00954be" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:31 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 Sep 11 23:07:31 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-78175b23-4ad6-4e7d-a05f-ea6ce00954be" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Deleting offline snapshot 78175b23-4ad6-4e7d-a05f-ea6ce00954be of volume 2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] snapshot_file for this snap is: volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e75d7d-79ef-46e1-ae37-6fc7ba2d511e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:31 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be Sep 11 23:07:31 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:31 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9" returned: 0 in 0.456s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:31 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9 Sep 11 23:07:31 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:31 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be" returned: 0 in 0.458s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2414cb34-f061-430b-81bf-abad00e1f44a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c03e02-0bfd-4583-b54a-bf5ebdd8fbf1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:32 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2e538241-441f-42c5-bb5d-36b2098898a9" returned: 0 in 0.389s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Lock "cinder-quobyte-2e538241-441f-42c5-bb5d-36b2098898a9" released by "delete_volume" :: held 0.917s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:32 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a Sep 11 23:07:32 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Created reservations ['af58881f-697d-4257-b8ab-52dc0e72d8c5', '66901886-aa81-4991-b247-1a76db4e83a7', '0f3f4027-fa68-4853-9526-67aa15327b2b', '5bc2128e-902b-4b07-a8e8-ae3f4e70802e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:32 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:32 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:32 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a" returned: 0 in 0.696s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:32 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.446s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:32 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Deleted volume successfully. Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49a8dde-901c-4b90-9d85-01bef39824cd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a8ffcf7d-1486-415b-a25c-e355256cd553 tempest-VolumesTransfersV357Test-1658129990 None] Lock "cinder-2e538241-441f-42c5-bb5d-36b2098898a9-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:32 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f Sep 11 23:07:32 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Flow 'volume_create_manager' (554a15db-1397-4601-ac07-fa7d2e95c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9681ef3b-5283-483d-b8a7-dffc79c25ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9681ef3b-5283-483d-b8a7-dffc79c25ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1700454208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944f991c-c649-4143-ba6b-914e6a6fb3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f209ff42349caa533a390fe543b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:33Z,use_quota=True,user_id='17eb083cdb7145028be7139527f50765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bba786-8bde-4676-a755-8c759d97170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68bba786-8bde-4676-a755-8c759d97170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39ea4b8-e7f7-48e9-83a9-6cca64575d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39ea4b8-e7f7-48e9-83a9-6cca64575d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944f991c-c649-4143-ba6b-914e6a6fb3ae', 'volume_name': 'volume-944f991c-c649-4143-ba6b-914e6a6fb3ae', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b214f1a-2f80-4f6a-aa3a-82c4b6fc5da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b214f1a-2f80-4f6a-aa3a-82c4b6fc5da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e643b1b-2a78-4739-9b44-6624fd75ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:33 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Volume 944f991c-c649-4143-ba6b-914e6a6fb3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944f991c-c649-4143-ba6b-914e6a6fb3ae', 'volume_size': 1} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1700454208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944f991c-c649-4143-ba6b-914e6a6fb3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f209ff42349caa533a390fe543b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:33Z,use_quota=True,user_id='17eb083cdb7145028be7139527f50765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Creating volume 944f991c-c649-4143-ba6b-914e6a6fb3ae {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:33 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:33 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae 1073741824 Sep 11 23:07:33 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:33 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f" returned: 0 in 0.565s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2414cb34-f061-430b-81bf-abad00e1f44a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a482c530-f864-431c-86f5-2529efbf9d94]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:33 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be Sep 11 23:07:33 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:33 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be" returned: 0 in 0.519s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:33 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2414cb34-f061-430b-81bf-abad00e1f44a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae 1073741824" returned: 0 in 0.624s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1badfab0-a50b-41fa-914c-89122f773edd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:33 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae Sep 11 23:07:33 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:33 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a Sep 11 23:07:33 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:34 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae" returned: 0 in 0.349s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e643b1b-2a78-4739-9b44-6624fd75ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944f991c-c649-4143-ba6b-914e6a6fb3ae', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c33cf08-450c-4bbf-b312-8c5936e3bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Volume volume-944f991c-c649-4143-ba6b-914e6a6fb3ae (944f991c-c649-4143-ba6b-914e6a6fb3ae): created successfully Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c33cf08-450c-4bbf-b312-8c5936e3bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Flow 'volume_create_manager' (554a15db-1397-4601-ac07-fa7d2e95c85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-630d4aeb-3f02-4348-87ed-a9dc4fbf6daa tempest-VolumesTransfersV357Test-1686490782 None] Created volume successfully. Sep 11 23:07:34 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a" returned: 0 in 0.600s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:34 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be Sep 11 23:07:34 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:34 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be" returned: 0 in 0.400s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:34 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be Sep 11 23:07:34 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.78175b23-4ad6-4e7d-a05f-ea6ce00954be" returned: 0 in 0.299s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f -F qcow2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:35 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f -F qcow2 Sep 11 23:07:35 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2414cb34-f061-430b-81bf-abad00e1f44a /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f -F qcow2" returned: 0 in 0.377s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Acquiring lock "cinder-944f991c-c649-4143-ba6b-914e6a6fb3ae-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-78175b23-4ad6-4e7d-a05f-ea6ce00954be" released by "_delete_snapshot" :: held 4.211s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Lock "cinder-944f991c-c649-4143-ba6b-914e6a6fb3ae-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" released by "delete_snapshot" :: held 4.259s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Acquiring lock "cinder-quobyte-944f991c-c649-4143-ba6b-914e6a6fb3ae" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Lock "cinder-quobyte-944f991c-c649-4143-ba6b-914e6a6fb3ae" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0542d-86ce-4e18-a471-ff2f2504e231]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Created reservations ['66c1bcaa-7dbe-4e58-a171-3ff8904248c0', '32d126a2-68a5-4ef3-bed7-64e5c6356c73', '8bf15908-1903-455f-8406-fd497f70faf8', '3540a182-9765-437d-969a-44e3de4600c6'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:35 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae Sep 11 23:07:35 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:35 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Delete snapshot completed successfully. Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-78175b23-4ad6-4e7d-a05f-ea6ce00954be-delete_snapshot" released by "delete_snapshot" :: held 4.704s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-c8d87ab9-38db-4883-bd69-56522761a37f-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-c8d87ab9-38db-4883-bd69-56522761a37f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-c8d87ab9-38db-4883-bd69-56522761a37f" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-c8d87ab9-38db-4883-bd69-56522761a37f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Deleting offline snapshot c8d87ab9-38db-4883-bd69-56522761a37f of volume 2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] snapshot_file for this snap is: volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5fdd32-38bf-4d6e-8f07-a7efa8fa0976]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f Sep 11 23:07:36 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae" returned: 0 in 0.596s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae Sep 11 23:07:36 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Flow 'volume_create_manager' (f20ae1f8-c7d4-402b-ac46-e3a2a8ae13c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0585de48-5912-4676-8198-374896bf6b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0585de48-5912-4676-8198-374896bf6b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-287874928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c87316-6310-425b-8e65-41460d5eb13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eb00a9f2874b7fb8a227c6da7462e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:36Z,use_quota=True,user_id='1a773458e2e4421f89e9e1d34ee5e246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db6fc17-e0ea-4da4-b8de-d2f089a0a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db6fc17-e0ea-4da4-b8de-d2f089a0a286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8de4c4a-e103-4eb8-b19a-abefee32b0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:36 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8de4c4a-e103-4eb8-b19a-abefee32b0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c87316-6310-425b-8e65-41460d5eb13d', 'volume_name': 'volume-b7c87316-6310-425b-8e65-41460d5eb13d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01ff117-2181-40b4-b53c-80838f60b098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01ff117-2181-40b4-b53c-80838f60b098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f9b029-f420-43b6-8846-4e75529ba039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:36 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Volume b7c87316-6310-425b-8e65-41460d5eb13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c87316-6310-425b-8e65-41460d5eb13d', 'volume_size': 1} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-287874928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c87316-6310-425b-8e65-41460d5eb13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eb00a9f2874b7fb8a227c6da7462e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:36Z,use_quota=True,user_id='1a773458e2e4421f89e9e1d34ee5e246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Creating volume b7c87316-6310-425b-8e65-41460d5eb13d {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:36 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f" returned: 0 in 0.569s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2414cb34-f061-430b-81bf-abad00e1f44a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:36 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d 1073741824 Sep 11 23:07:36 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-944f991c-c649-4143-ba6b-914e6a6fb3ae" returned: 0 in 0.434s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Lock "cinder-quobyte-944f991c-c649-4143-ba6b-914e6a6fb3ae" released by "delete_volume" :: held 1.110s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e81630a-7f4c-4dcf-8956-4aecfe56f235]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Created reservations ['4afc01c6-527a-42f7-895a-e1b1ed22b5a8', 'b931f701-253d-4cee-b7b7-b08b65f930f2', 'ea893253-3fcf-4a2f-8fcd-2650241b5a49', '8060ffb6-d927-4147-bf49-b0cdfc20fa0e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:36 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a Sep 11 23:07:36 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:37 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:37 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a" returned: 0 in 0.471s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d 1073741824" returned: 0 in 0.568s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f Sep 11 23:07:37 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:37 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.369s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Deleted volume successfully. Sep 11 23:07:37 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d Sep 11 23:07:37 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-163e5bc6-6003-45f5-b72c-331ddfd98dee tempest-VolumesTransfersV357Test-1658129990 None] Lock "cinder-944f991c-c649-4143-ba6b-914e6a6fb3ae-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:37 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f" returned: 0 in 0.435s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:37 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d" returned: 0 in 0.370s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:37 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f Sep 11 23:07:37 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f9b029-f420-43b6-8846-4e75529ba039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c87316-6310-425b-8e65-41460d5eb13d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d4b8b2-c769-4738-aa16-d1f9a060428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:37 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Volume volume-b7c87316-6310-425b-8e65-41460d5eb13d (b7c87316-6310-425b-8e65-41460d5eb13d): created successfully Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d4b8b2-c769-4738-aa16-d1f9a060428f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Flow 'volume_create_manager' (f20ae1f8-c7d4-402b-ac46-e3a2a8ae13c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a32788b4-4093-4ce4-a1f0-31fcae490f4b tempest-VolumesListAdminTestJSON-730447052 None] Created volume successfully. Sep 11 23:07:38 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a.c8d87ab9-38db-4883-bd69-56522761a37f" returned: 0 in 0.391s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-c8d87ab9-38db-4883-bd69-56522761a37f" released by "_delete_snapshot" :: held 2.035s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" released by "delete_snapshot" :: held 2.075s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Created reservations ['ad581dc5-cece-44d8-a369-c76bf6a7115b', '2f005fde-91aa-4135-9e5a-98bf4af551c4', '1527b475-52b0-4c32-9f56-fa5560bacfbd', '507a3cf3-0b6d-4a25-a56c-3261b26f115f'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:38 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Delete snapshot completed successfully. Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-c8d87ab9-38db-4883-bd69-56522761a37f-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Snapshots deleted, issuing volume delete {{(pid=88026) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[96334a42-31dc-440b-80df-c85d3e9bfec3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:38 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a Sep 11 23:07:38 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:39 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a" returned: 0 in 0.661s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:39 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a Sep 11 23:07:39 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=169,cinder:UPDATE=214,cinder:INSERT=46,cinder:DELETE=22 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Flow 'volume_create_manager' (dfbb5f38-cc25-4576-944e-3f45132f22d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4c3d4c-8531-4df2-973b-d2830ed54628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4c3d4c-8531-4df2-973b-d2830ed54628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1010192276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d461771-6a5a-4785-9bcd-d065859624b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eb00a9f2874b7fb8a227c6da7462e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:39Z,use_quota=True,user_id='1a773458e2e4421f89e9e1d34ee5e246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101b16db-1dc5-41f3-b080-022a9fe8352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101b16db-1dc5-41f3-b080-022a9fe8352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42515f84-cd8c-4bd3-9a9c-3300b6089470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42515f84-cd8c-4bd3-9a9c-3300b6089470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d461771-6a5a-4785-9bcd-d065859624b4', 'volume_name': 'volume-2d461771-6a5a-4785-9bcd-d065859624b4', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a67ad15-e754-4b71-8db2-5e9f6fe4cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a67ad15-e754-4b71-8db2-5e9f6fe4cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7993e1-fd50-48df-960e-a925e43da7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:39 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Volume 2d461771-6a5a-4785-9bcd-d065859624b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d461771-6a5a-4785-9bcd-d065859624b4', 'volume_size': 1} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1010192276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d461771-6a5a-4785-9bcd-d065859624b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eb00a9f2874b7fb8a227c6da7462e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:39Z,use_quota=True,user_id='1a773458e2e4421f89e9e1d34ee5e246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Creating volume 2d461771-6a5a-4785-9bcd-d065859624b4 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:39 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:39 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2414cb34-f061-430b-81bf-abad00e1f44a" returned: 0 in 0.590s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:39 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 1073741824 Sep 11 23:07:39 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-2414cb34-f061-430b-81bf-abad00e1f44a" released by "delete_volume" :: held 1.343s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Created reservations ['ef090291-b051-44e8-a066-e77f59808221', 'd0ab299e-56d5-47e6-ba7b-c6c3e912e3ba', 'd1221e09-c8ea-4be8-bc99-bc00b1835293', '026aede2-6656-4bc7-95a1-dba2289f06b4'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:39 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:39 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:40 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.396s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Deleted volume successfully. Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4729813d-529d-4a45-9606-13ec3bafd5f1 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-2414cb34-f061-430b-81bf-abad00e1f44a-delete_volume" released by "delete_volume" :: held 9.223s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:40 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 1073741824" returned: 0 in 0.719s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:40 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 Sep 11 23:07:40 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:40 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4" returned: 0 in 0.388s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7993e1-fd50-48df-960e-a925e43da7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d461771-6a5a-4785-9bcd-d065859624b4', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb64e9ce-f668-4383-93ca-d56a8bfb359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:40 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Volume volume-2d461771-6a5a-4785-9bcd-d065859624b4 (2d461771-6a5a-4785-9bcd-d065859624b4): created successfully Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb64e9ce-f668-4383-93ca-d56a8bfb359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Flow 'volume_create_manager' (dfbb5f38-cc25-4576-944e-3f45132f22d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5b42d2fb-7d22-41b8-8840-1060d3fa94b1 tempest-VolumesListAdminTestJSON-730447052 None] Created volume successfully. Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Flow 'volume_create_manager' (b58f2ade-f73f-4a90-9300-a46aa1848abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efd90a8-6fc9-4848-af48-67b887f562e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efd90a8-6fc9-4848-af48-67b887f562e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1355726872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb3ea4e-b343-4856-a2bb-617ce7c2cf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe8bf11f1743549911937b00a6183e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:41Z,use_quota=True,user_id='54d1a6b4e40f479c87d9c5323f441b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192014d8-ff0b-48cb-83d6-c3624cc519e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192014d8-ff0b-48cb-83d6-c3624cc519e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b389ee-c827-4547-ad7e-3edd5fd2ff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b389ee-c827-4547-ad7e-3edd5fd2ff56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb3ea4e-b343-4856-a2bb-617ce7c2cf72', 'volume_name': 'volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59823800-b6f2-4684-85f7-a04fce131a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59823800-b6f2-4684-85f7-a04fce131a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737ffd5b-0b7d-40d1-82d9-8a5a557c3e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Volume deb3ea4e-b343-4856-a2bb-617ce7c2cf72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72', 'volume_size': 1} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1355726872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb3ea4e-b343-4856-a2bb-617ce7c2cf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe8bf11f1743549911937b00a6183e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:41Z,use_quota=True,user_id='54d1a6b4e40f479c87d9c5323f441b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Creating volume deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:41 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:41 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 1073741824 Sep 11 23:07:41 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Flow 'volume_create_manager' (91771b00-28b2-4e49-b7a6-2f3b44eb42fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5edb19-010a-47a0-aa6a-ff2877ffbd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5edb19-010a-47a0-aa6a-ff2877ffbd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1430798219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac6d9cf-a877-4015-b20a-8b7c965e35e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eb00a9f2874b7fb8a227c6da7462e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:42Z,use_quota=True,user_id='1a773458e2e4421f89e9e1d34ee5e246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc866ff4-6d09-46ec-aa8a-db4cbdc75385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc866ff4-6d09-46ec-aa8a-db4cbdc75385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60055da5-0556-4c79-98fb-983188519173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:42 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60055da5-0556-4c79-98fb-983188519173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac6d9cf-a877-4015-b20a-8b7c965e35e6', 'volume_name': 'volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02abd11e-6505-460b-9746-70a8c94b1d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02abd11e-6505-460b-9746-70a8c94b1d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbf2569-787f-47b8-b86c-63a53a5fb93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Volume dac6d9cf-a877-4015-b20a-8b7c965e35e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6', 'volume_size': 1} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 1073741824" returned: 0 in 0.921s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:42 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 Sep 11 23:07:42 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:42 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" returned: 0 in 0.318s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1430798219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac6d9cf-a877-4015-b20a-8b7c965e35e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19eb00a9f2874b7fb8a227c6da7462e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:42Z,use_quota=True,user_id='1a773458e2e4421f89e9e1d34ee5e246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Creating volume dac6d9cf-a877-4015-b20a-8b7c965e35e6 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:43 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737ffd5b-0b7d-40d1-82d9-8a5a557c3e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18663b38-6a25-4cbc-8793-1d0aef68cd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:43 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 1073741824 Sep 11 23:07:43 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Volume volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 (deb3ea4e-b343-4856-a2bb-617ce7c2cf72): created successfully Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18663b38-6a25-4cbc-8793-1d0aef68cd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Flow 'volume_create_manager' (b58f2ade-f73f-4a90-9300-a46aa1848abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:43 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8908e536-639d-4729-b25a-f8c03f87f9f2 tempest-VolumesDeleteCascade-1565356369 None] Created volume successfully. Sep 11 23:07:43 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 1073741824" returned: 0 in 0.629s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:43 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 Sep 11 23:07:43 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:44 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6" returned: 0 in 0.328s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.121s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbf2569-787f-47b8-b86c-63a53a5fb93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b48eb7-12a1-48a3-8b6f-a40683b943df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Creating offline snapshot 5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f of volume deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:07:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Volume volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 (dac6d9cf-a877-4015-b20a-8b7c965e35e6): created successfully Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b48eb7-12a1-48a3-8b6f-a40683b943df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Flow 'volume_create_manager' (91771b00-28b2-4e49-b7a6-2f3b44eb42fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedc5bc9-6f8d-4d54-b826-a9e2ad814427]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7c64b6de-a2f7-4195-a58f-4f6a88bca704 tempest-VolumesListAdminTestJSON-730447052 None] Created volume successfully. Sep 11 23:07:44 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 Sep 11 23:07:44 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:44 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" returned: 0 in 0.457s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:44 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f 1G Sep 11 23:07:44 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:45 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f 1G" returned: 0 in 0.574s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:45 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f Sep 11 23:07:45 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:45 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" returned: 0 in 0.438s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:45 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f is being set with open permissions: ugo+rw Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:45 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f Sep 11 23:07:45 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Flow 'volume_create_manager' (040cc06b-036c-43f1-a2fb-1458199a14b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90063e0-c1e9-4f7a-8fc9-23e3eb280c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90063e0-c1e9-4f7a-8fc9-23e3eb280c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5d9625-f222-4dd9-93ad-fc21e34ee6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32e7ee9f34d493da312a2b0e489d64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:46Z,use_quota=True,user_id='350b97479b3546c0b18f48bbfbaf4c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f9c573-23f9-4f6a-96a3-9c3cfa2a7241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f9c573-23f9-4f6a-96a3-9c3cfa2a7241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25989eea-cb38-434e-bd01-f851b425af54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25989eea-cb38-434e-bd01-f851b425af54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5d9625-f222-4dd9-93ad-fc21e34ee6c7', 'volume_name': 'volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4c31a1-5af8-4967-8215-81489f36e83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4c31a1-5af8-4967-8215-81489f36e83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd6233a-b7b2-4b0c-930e-9c29c89fc7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Volume 2b5d9625-f222-4dd9-93ad-fc21e34ee6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7', 'volume_size': 1} Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:45 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" returned: 0 in 0.421s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:46 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.info Sep 11 23:07:46 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:46 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.info" returned: 0 in 0.327s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:46 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.info is being set with open permissions: ugo+rw Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:46 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.info Sep 11 23:07:46 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:46 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.info" returned: 0 in 0.302s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5d9625-f222-4dd9-93ad-fc21e34ee6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b32e7ee9f34d493da312a2b0e489d64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:46Z,use_quota=True,user_id='350b97479b3546c0b18f48bbfbaf4c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Creating volume 2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:46 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:46 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 1073741824 Sep 11 23:07:46 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:46 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d3072075-b0c8-4cc7-9be8-fd4a1190dec2 tempest-VolumesDeleteCascade-1565356369 None] Create snapshot completed successfully Sep 11 23:07:47 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 1073741824" returned: 0 in 0.639s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:47 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 Sep 11 23:07:47 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:47 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7" returned: 0 in 0.369s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd6233a-b7b2-4b0c-930e-9c29c89fc7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab08dc7-a4a5-4ddf-9ae8-6d8626783fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Volume volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 (2b5d9625-f222-4dd9-93ad-fc21e34ee6c7): created successfully Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab08dc7-a4a5-4ddf-9ae8-6d8626783fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Flow 'volume_create_manager' (040cc06b-036c-43f1-a2fb-1458199a14b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-972160a6-f5a7-4108-8188-2c8014bc9a6a tempest-VolumesListAdminTestJSON-1720497470 None] Created volume successfully. Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Flow 'volume_create_manager' (64d7b7b2-726a-4989-8d10-536772eee0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85edfa42-893b-4fa3-b655-5772bab8533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85edfa42-893b-4fa3-b655-5772bab8533d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1680051555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba4f20a-b8cd-4266-8f28-61ff44727749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc202a3f4a774c0bb5719151cd1f58c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:48Z,use_quota=True,user_id='697559b7b97b49479cbcbb2b5076c931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac47b599-d7df-4431-bbe9-759d48980349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac47b599-d7df-4431-bbe9-759d48980349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578fda0f-0934-4163-8b4c-93e2a9d25232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578fda0f-0934-4163-8b4c-93e2a9d25232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba4f20a-b8cd-4266-8f28-61ff44727749', 'volume_name': 'volume-9ba4f20a-b8cd-4266-8f28-61ff44727749', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6d3ce9-b75d-4f20-b3df-84199dc32d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6d3ce9-b75d-4f20-b3df-84199dc32d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6f546e-b1da-4806-b955-ab6c76024171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Volume 9ba4f20a-b8cd-4266-8f28-61ff44727749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba4f20a-b8cd-4266-8f28-61ff44727749', 'volume_size': 1} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1680051555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba4f20a-b8cd-4266-8f28-61ff44727749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc202a3f4a774c0bb5719151cd1f58c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:48Z,use_quota=True,user_id='697559b7b97b49479cbcbb2b5076c931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Creating volume 9ba4f20a-b8cd-4266-8f28-61ff44727749 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:48 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:48 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 1073741824 Sep 11 23:07:48 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Flow 'volume_create_manager' (3feb8ebf-0556-4957-a9ea-b8f2b9ba78e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f124a6e2-64b5-4940-a0e1-f89364678841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f124a6e2-64b5-4940-a0e1-f89364678841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1145623894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73eb08d8-5101-4f13-984d-ab6fcf95fd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fe8bf11f1743549911937b00a6183e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:48Z,use_quota=True,user_id='54d1a6b4e40f479c87d9c5323f441b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aeaf704-8fbb-4159-a22a-206cf6a78cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aeaf704-8fbb-4159-a22a-206cf6a78cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e18da2f-25d0-4aac-a75f-a5331e7eae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e18da2f-25d0-4aac-a75f-a5331e7eae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73eb08d8-5101-4f13-984d-ab6fcf95fd3a', 'volume_name': 'volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a', 'volume_size': 1, 'snapshot_id': '5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c5c65c-eefb-44cb-82fe-b473f98810e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c5c65c-eefb-44cb-82fe-b473f98810e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626e49bd-3de2-4fcf-a342-c9ba7df11186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Volume 73eb08d8-5101-4f13-984d-ab6fcf95fd3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a', 'volume_size': 1, 'snapshot_id': '5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f'} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:48 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 1073741824" returned: 0 in 0.557s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:48 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 Sep 11 23:07:48 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:48 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749" returned: 0 in 0.329s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.677s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6f546e-b1da-4806-b955-ab6c76024171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba4f20a-b8cd-4266-8f28-61ff44727749', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf882af-6745-424b-9b2c-b8ebbbd2cfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:48 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Volume volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 (9ba4f20a-b8cd-4266-8f28-61ff44727749): created successfully Sep 11 23:07:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf882af-6745-424b-9b2c-b8ebbbd2cfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Flow 'volume_create_manager' (64d7b7b2-726a-4989-8d10-536772eee0f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Creating volume 73eb08d8-5101-4f13-984d-ab6fcf95fd3a from snapshot 5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] snapshot: 5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f, volume: 73eb08d8-5101-4f13-984d-ab6fcf95fd3a, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:07:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ff6b4a74-9910-462d-9574-ccca28969729 tempest-VolumesNegativeTest-906539078 None] Created volume successfully. Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf1b934-6555-47e0-8e94-06baad347f4d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Acquiring lock "cinder-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Lock "cinder-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Acquiring lock "cinder-quobyte-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Lock "cinder-quobyte-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:49 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f Sep 11 23:07:49 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[952c789e-0c75-4955-bb73-017117ce6b0c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "cinder-dac6d9cf-a877-4015-b20a-8b7c965e35e6-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-dac6d9cf-a877-4015-b20a-8b7c965e35e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "cinder-quobyte-dac6d9cf-a877-4015-b20a-8b7c965e35e6" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-quobyte-dac6d9cf-a877-4015-b20a-8b7c965e35e6" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:49 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32294c-158a-4e75-ad54-9d67fa335008]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:49 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:49 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 Sep 11 23:07:49 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:49 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" returned: 0 in 0.618s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a3afe6-2fa0-4dc0-9fb9-5d6e44d19b4f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:49 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7" returned: 0 in 0.599s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:49 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 Sep 11 23:07:49 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:50 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7 Sep 11 23:07:50 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:50 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6" returned: 0 in 0.543s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:50 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6 Sep 11 23:07:50 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:50 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" returned: 0 in 0.521s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:50 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a Sep 11 23:07:50 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:50 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7" returned: 0 in 0.521s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Lock "cinder-quobyte-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7" released by "delete_volume" :: held 1.192s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:50 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dac6d9cf-a877-4015-b20a-8b7c965e35e6" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-quobyte-dac6d9cf-a877-4015-b20a-8b7c965e35e6" released by "delete_volume" :: held 1.071s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Created reservations ['44974dae-594c-459e-b864-9e3e21ad1c95', 'c20ffcca-b9fb-4699-bea2-ee774bb4aa82', '9ba7565c-6e1f-4dcd-a403-00ac416ecf3a', 'f048e5bd-ea99-488e-823e-17cbe9575419'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Created reservations ['c8c9b998-4e12-40d9-b554-9ad7b78bd1c7', 'c6da546a-cab2-4cc5-80c8-bb9b5ce035dc', '97611e8d-8499-489d-bca2-236a6508701e', '70fdb528-85c5-4067-84fc-67d1a34c06c7'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:50 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:50 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:50 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:50 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:51 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.969s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 1.058s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:51 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Deleted volume successfully. Sep 11 23:07:51 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Deleted volume successfully. Sep 11 23:07:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5c43b8ac-3ae8-4bbd-b4f5-eceae1fe6506 tempest-VolumesListAdminTestJSON-1720497470 None] Lock "cinder-2b5d9625-f222-4dd9-93ad-fc21e34ee6c7-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-13daf4cf-4d37-43df-bdde-fcb42616d52b tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-dac6d9cf-a877-4015-b20a-8b7c965e35e6-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "cinder-2d461771-6a5a-4785-9bcd-d065859624b4-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-2d461771-6a5a-4785-9bcd-d065859624b4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "cinder-quobyte-2d461771-6a5a-4785-9bcd-d065859624b4" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-quobyte-2d461771-6a5a-4785-9bcd-d065859624b4" acquired by "delete_volume" :: waited 0.039s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f607fa84-4e59-4596-97e5-74c2dea3303a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:53 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 Sep 11 23:07:53 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:54 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4" returned: 0 in 1.455s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:54 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4 Sep 11 23:07:54 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:54 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d461771-6a5a-4785-9bcd-d065859624b4" returned: 0 in 0.581s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-quobyte-2d461771-6a5a-4785-9bcd-d065859624b4" released by "delete_volume" :: held 2.198s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:55 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Created reservations ['66e46840-453b-49bb-9d3f-12a3036617f9', 'b576131b-9533-4acc-857b-265b6732ac31', '5c8d3d7f-9478-43b8-923e-79e6c593c398', '43d9d552-6ca8-4c36-aa8e-2ccfa122651c'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:55 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:55 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:56 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 1.083s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:56 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:07:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Deleted volume successfully. Sep 11 23:07:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-15021fc6-d2b3-4343-b686-30a258542d61 tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-2d461771-6a5a-4785-9bcd-d065859624b4-delete_volume" released by "delete_volume" :: held 4.205s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "cinder-b7c87316-6310-425b-8e65-41460d5eb13d-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-b7c87316-6310-425b-8e65-41460d5eb13d-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "cinder-quobyte-b7c87316-6310-425b-8e65-41460d5eb13d" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:07:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-quobyte-b7c87316-6310-425b-8e65-41460d5eb13d" acquired by "delete_volume" :: waited 0.046s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:07:57 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd5d616-6eb7-423d-93df-d497ae41f72e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:07:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:58 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d Sep 11 23:07:58 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:58 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" returned: 0 in 8.338s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:58 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:07:58 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Converted 1024.00 MB image at 122.79 MB/s Sep 11 23:07:58 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a is being set with open permissions: ugo+rw Sep 11 23:07:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:58 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a Sep 11 23:07:58 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:59 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d" returned: 0 in 1.511s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:59 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d Sep 11 23:07:59 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:07:59 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" returned: 0 in 0.457s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" released by "_copy_volume_from_snapshot" :: held 10.088s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" released by "_create_volume_from_snapshot" :: held 10.183s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.241s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626e49bd-3de2-4fcf-a342-c9ba7df11186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a', 'volume_size': 1, 'snapshot_id': '5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3f432c-3c3a-4e68-9e53-803dc7d1898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:07:59 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Volume volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a (73eb08d8-5101-4f13-984d-ab6fcf95fd3a): created successfully Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3f432c-3c3a-4e68-9e53-803dc7d1898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Flow 'volume_create_manager' (3feb8ebf-0556-4957-a9ea-b8f2b9ba78e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:07:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-383c5ddd-a655-4e09-840f-814dc25d0e23 tempest-VolumesDeleteCascade-1565356369 None] Created volume successfully. Sep 11 23:07:59 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b7c87316-6310-425b-8e65-41460d5eb13d" returned: 0 in 0.395s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-quobyte-b7c87316-6310-425b-8e65-41460d5eb13d" released by "delete_volume" :: held 2.047s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Created reservations ['f3f1010c-57d2-4eaa-8d0e-aa478b0ea092', 'bb18921b-4ec7-43db-9d58-9173c6fe8b9f', '5f3ee149-79b8-43b4-9984-26d409befcf1', '516bd319-f0eb-4b59-9125-a92231df7c61'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:07:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:07:59 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:07:59 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:00 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.514s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Deleted volume successfully. Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-712fe315-faec-45cf-8a44-9a2751fce33d tempest-VolumesListAdminTestJSON-730447052 None] Lock "cinder-b7c87316-6310-425b-8e65-41460d5eb13d-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-deb3ea4e-b343-4856-a2bb-617ce7c2cf72-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-deb3ea4e-b343-4856-a2bb-617ce7c2cf72-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Performing cascade delete. {{(pid=88026) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Deleting offline snapshot 5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f of volume deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] snapshot_file for this snap is: volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab77964-0f2c-4960-b000-5b514fa1f472]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:00 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f Sep 11 23:08:00 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:01 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" returned: 0 in 0.746s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c89f2f-b326-4a70-9c32-42086d55baac]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:01 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 Sep 11 23:08:01 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:02 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" returned: 0 in 0.957s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:02 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f Sep 11 23:08:02 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:03 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" returned: 0 in 0.545s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:03 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f Sep 11 23:08:03 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:03 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72.5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" returned: 0 in 0.408s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f" released by "_delete_snapshot" :: held 2.821s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" released by "delete_snapshot" :: held 2.878s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Created reservations ['954959dd-22bf-49ad-98c0-ccdc54c1fa4d', '826a8b80-894a-40c8-97a3-449c66cf2ae6', '7d419fd6-be36-459f-8ee8-49a734280a10', 'f3d54caa-7be4-4496-bae0-197f13cbf372'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Delete snapshot completed successfully. Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-5d6f23ae-f4a0-42ed-b039-2dd3d2bea22f-delete_snapshot" released by "delete_snapshot" :: held 3.240s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Snapshots deleted, issuing volume delete {{(pid=88026) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[39615487-0922-4e63-8a78-5f83f0594d18]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:04 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 Sep 11 23:08:04 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:04 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" returned: 0 in 0.594s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:04 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72 Sep 11 23:08:04 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:04 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" returned: 0 in 0.353s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-deb3ea4e-b343-4856-a2bb-617ce7c2cf72" released by "delete_volume" :: held 1.043s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:04 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=151,cinder:UPDATE=196,cinder:INSERT=52,cinder:DELETE=17 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:08:04 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Created reservations ['87099686-c218-46e9-97f6-56442ae78c7a', 'db6958df-c7b0-4079-b201-c043424fa47b', 'f472ad88-c455-4165-8880-769f4674eab3', '036f966d-3a95-48e8-9967-c4a5c614f838'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:05 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:08:05 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:05 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.426s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:05 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Deleted volume successfully. Sep 11 23:08:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6608ef87-cff7-4f23-b38f-0bdf8a537113 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-deb3ea4e-b343-4856-a2bb-617ce7c2cf72-delete_volume" released by "delete_volume" :: held 5.265s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-73eb08d8-5101-4f13-984d-ab6fcf95fd3a-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-73eb08d8-5101-4f13-984d-ab6fcf95fd3a-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "cinder-quobyte-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" acquired by "delete_volume" :: waited 0.069s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:07 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac5fcf5-61c0-49aa-ae74-9ebd2ae9ccde]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:07 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a Sep 11 23:08:07 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:08 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" returned: 0 in 0.947s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:08 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a Sep 11 23:08:08 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:08 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" returned: 0 in 0.574s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-quobyte-73eb08d8-5101-4f13-984d-ab6fcf95fd3a" released by "delete_volume" :: held 1.637s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:08 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Created reservations ['bcb8b4f7-9c67-49e1-9a66-b0fc7bac89fe', '01a5ed0f-57e3-4eda-a220-f18475ae11ac', '32a57776-054b-41d6-90a1-246df89163a6', 'f0c66321-48e3-480d-92bd-a9c400006c0c'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:09 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:08:09 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:09 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.694s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Deleted volume successfully. Sep 11 23:08:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b08de10e-5310-4cff-b09a-6b3a60c0e3e4 tempest-VolumesDeleteCascade-1565356369 None] Lock "cinder-73eb08d8-5101-4f13-984d-ab6fcf95fd3a-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:08:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:11 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:08:11 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:12 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.626s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:12 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:12 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:08:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:08:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Flow 'volume_create_manager' (465b3dd0-e065-4a46-9f45-60712a6c5f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83716256-500f-447d-b5d3-d98f0223cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83716256-500f-447d-b5d3-d98f0223cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-313392737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7bffd9-f35b-480b-aa39-77bd1e18be88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6beb828f0d43434da6961b09be962144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:17Z,use_quota=True,user_id='8ef8dc8ece5b4fc0a44532b59a1bb799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5739c911-4aa1-43b0-97cd-a355da7ceb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5739c911-4aa1-43b0-97cd-a355da7ceb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd3ae7c-8f7a-4518-b7fb-599fdb9f3c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd3ae7c-8f7a-4518-b7fb-599fdb9f3c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f7bffd9-f35b-480b-aa39-77bd1e18be88', 'volume_name': 'volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdd6eab-381e-4629-9f13-dfae2c4295f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdd6eab-381e-4629-9f13-dfae2c4295f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ff73e3-a534-44ef-a9ec-09986f651a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:17 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Volume 9f7bffd9-f35b-480b-aa39-77bd1e18be88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:08:17 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Trying to clone 9f7bffd9-f35b-480b-aa39-77bd1e18be88 from image 30dc07db-5049-43e5-a274-fa94fe6ac71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:08:18 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:08:18 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:08:18 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[466114de-6922-414c-883c-9d8f0bad8e30]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:18 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD Sep 11 23:08:18 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:18 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:18 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d is fetched for user 8ef8dc8ece5b4fc0a44532b59a1bb799. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ba3576-9e72-4ac8-a678-ac76ea9f5d45]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:19 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD Sep 11 23:08:19 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:19 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-313392737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7bffd9-f35b-480b-aa39-77bd1e18be88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6beb828f0d43434da6961b09be962144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:17Z,use_quota=True,user_id='8ef8dc8ece5b4fc0a44532b59a1bb799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Creating volume 9f7bffd9-f35b-480b-aa39-77bd1e18be88 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:19 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:08:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:19 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 1073741824 Sep 11 23:08:19 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:20 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 1073741824" returned: 0 in 0.757s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:20 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 Sep 11 23:08:20 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:20 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88" returned: 0 in 0.409s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:20 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Attempting download of 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 9f7bffd9-f35b-480b-aa39-77bd1e18be88. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:08:20 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0858392f-0375-4a4f-aa0f-c4170d081fb6]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_rd4npnyw {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:20 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_rd4npnyw Sep 11 23:08:20 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:21 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_rd4npnyw" returned: 0 in 0.362s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_rd4npnyw {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:21 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_rd4npnyw Sep 11 23:08:21 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:21 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_rd4npnyw" returned: 1 in 0.484s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_rd4npnyw' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:08:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a31dffa-6218-432d-8a3d-59fe9c1361fb]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:21 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD Sep 11 23:08:21 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:22 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:22 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] 30dc07db-5049-43e5-a274-fa94fe6ac71d was qcow2, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:08:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:22 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 Sep 11 23:08:22 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Flow 'volume_create_manager' (2c5d4f18-587c-4d46-bece-c08a554ff5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4519ad53-c6ad-42f2-9dd3-1df3a3a8b7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4519ad53-c6ad-42f2-9dd3-1df3a3a8b7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-142541304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd46f807-e33b-49ed-9f56-d59b16767493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac8e3f15213407fa3da00033dad9719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:24Z,use_quota=True,user_id='ce25c25587c443e3bfa7013bb62276e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d7d351-d579-4c3d-97c9-dddb688d2d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d7d351-d579-4c3d-97c9-dddb688d2d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2f61cd-2599-4ca1-9d43-d136d5d726c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2f61cd-2599-4ca1-9d43-d136d5d726c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd46f807-e33b-49ed-9f56-d59b16767493', 'volume_name': 'volume-cd46f807-e33b-49ed-9f56-d59b16767493', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791e07eb-e02a-4359-a197-9d41bd6ad6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791e07eb-e02a-4359-a197-9d41bd6ad6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1ed202-62e7-44b7-a453-8486c5c33b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:24 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Volume cd46f807-e33b-49ed-9f56-d59b16767493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd46f807-e33b-49ed-9f56-d59b16767493', 'volume_size': 1} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-142541304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd46f807-e33b-49ed-9f56-d59b16767493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac8e3f15213407fa3da00033dad9719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:24Z,use_quota=True,user_id='ce25c25587c443e3bfa7013bb62276e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Creating volume cd46f807-e33b-49ed-9f56-d59b16767493 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:24 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:24 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 1073741824 Sep 11 23:08:24 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Acquiring lock "cinder-9ba4f20a-b8cd-4266-8f28-61ff44727749-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Lock "cinder-9ba4f20a-b8cd-4266-8f28-61ff44727749-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Acquiring lock "cinder-quobyte-9ba4f20a-b8cd-4266-8f28-61ff44727749" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Lock "cinder-quobyte-9ba4f20a-b8cd-4266-8f28-61ff44727749" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c653a-b134-48b0-b9d0-62eb6fd7f5a2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:24 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88" returned: 0 in 2.573s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_8z877ffndevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:08:24 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Converted 112.00 MB image at 43.50 MB/s Sep 11 23:08:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:24 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 Sep 11 23:08:24 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:24 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 1G Sep 11 23:08:24 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:24 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 1073741824" returned: 0 in 0.629s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:25 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 Sep 11 23:08:25 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:25 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749" returned: 0 in 0.576s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:25 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749 Sep 11 23:08:25 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:25 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 1G" returned: 0 in 0.503s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Downloaded image 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 9f7bffd9-f35b-480b-aa39-77bd1e18be88 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d for user 8ef8dc8ece5b4fc0a44532b59a1bb799 is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Marking volume 9f7bffd9-f35b-480b-aa39-77bd1e18be88 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Copying metadata from image 30dc07db-5049-43e5-a274-fa94fe6ac71d to 9f7bffd9-f35b-480b-aa39-77bd1e18be88. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Creating volume glance metadata for volume 9f7bffd9-f35b-480b-aa39-77bd1e18be88 backed by image 30dc07db-5049-43e5-a274-fa94fe6ac71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:08:25 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ff73e3-a534-44ef-a9ec-09986f651a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa60c83b-ce94-40a2-8051-c3cf5bef5dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493" returned: 0 in 0.363s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1ed202-62e7-44b7-a453-8486c5c33b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd46f807-e33b-49ed-9f56-d59b16767493', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12101d2-07a2-4c49-a7a8-3fe9778a5fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:25 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Volume volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 (9f7bffd9-f35b-480b-aa39-77bd1e18be88): created successfully Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa60c83b-ce94-40a2-8051-c3cf5bef5dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Flow 'volume_create_manager' (465b3dd0-e065-4a46-9f45-60712a6c5f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:25 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Volume volume-cd46f807-e33b-49ed-9f56-d59b16767493 (cd46f807-e33b-49ed-9f56-d59b16767493): created successfully Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12101d2-07a2-4c49-a7a8-3fe9778a5fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Flow 'volume_create_manager' (2c5d4f18-587c-4d46-bece-c08a554ff5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-17f46a3a-9eef-4a27-a2aa-691d2e5004b5 tempest-VolumesImageMetadata-801126289 None] Created volume successfully. Sep 11 23:08:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4f4dc9ae-b5d7-45bb-aaab-5383a8b287ee tempest-AttachVolumeNegativeTest-1722998956 None] Created volume successfully. Sep 11 23:08:25 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ba4f20a-b8cd-4266-8f28-61ff44727749" returned: 0 in 0.379s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Lock "cinder-quobyte-9ba4f20a-b8cd-4266-8f28-61ff44727749" released by "delete_volume" :: held 1.015s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Created reservations ['00e49dcb-51cc-42fa-9be2-ac2af1de75cc', 'a065ab48-2073-4983-97c8-431abeda5f59', '77487fad-7e10-40d6-92e0-4db3c35e5829', 'f402d39c-3fb8-4eed-8fea-cfac9ba9cccd'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:25 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:08:25 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:25 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.257s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:25 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Deleted volume successfully. Sep 11 23:08:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f30d876-19c7-478b-9e51-af61428d4f25 tempest-VolumesNegativeTest-906539078 None] Lock "cinder-9ba4f20a-b8cd-4266-8f28-61ff44727749-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Acquiring lock "cinder-9f7bffd9-f35b-480b-aa39-77bd1e18be88-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Lock "cinder-9f7bffd9-f35b-480b-aa39-77bd1e18be88-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Acquiring lock "cinder-quobyte-9f7bffd9-f35b-480b-aa39-77bd1e18be88" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Lock "cinder-quobyte-9f7bffd9-f35b-480b-aa39-77bd1e18be88" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ed04df-f0ab-44a7-a492-e137ad5fabef]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:27 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 Sep 11 23:08:27 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-d4f70bf1-f86f-4d8e-bded-bbd661450e86 req-3a12f44b-3fb0-4fbf-b290-28d57965b750 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-d4f70bf1-f86f-4d8e-bded-bbd661450e86 req-3a12f44b-3fb0-4fbf-b290-28d57965b750 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-d4f70bf1-f86f-4d8e-bded-bbd661450e86 req-3a12f44b-3fb0-4fbf-b290-28d57965b750 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-d4f70bf1-f86f-4d8e-bded-bbd661450e86 req-3a12f44b-3fb0-4fbf-b290-28d57965b750 tempest-AttachVolumeNegativeTest-1722998956 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-cd46f807-e33b-49ed-9f56-d59b16767493', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b2c53b6-932a-4542-ae5c-65c572a2edd7', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:08:27 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-d4f70bf1-f86f-4d8e-bded-bbd661450e86 req-3a12f44b-3fb0-4fbf-b290-28d57965b750 tempest-AttachVolumeNegativeTest-1722998956 None] attachment_update completed successfully. Sep 11 23:08:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88" returned: 0 in 0.503s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:27 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:27 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88 Sep 11 23:08:27 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:28 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9f7bffd9-f35b-480b-aa39-77bd1e18be88" returned: 0 in 0.530s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Lock "cinder-quobyte-9f7bffd9-f35b-480b-aa39-77bd1e18be88" released by "delete_volume" :: held 1.161s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Created reservations ['01946753-fe81-4441-934c-e2935faa7d73', 'd6a2de2f-c34d-4487-8119-4a66e87d9ba6', 'a10cb51b-fb12-45cd-a782-20f68d5bc2c1', '8452162b-2aec-4ffc-95a7-aff0aaa50c85'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:28 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:08:28 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:28 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.363s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:28 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Deleted volume successfully. Sep 11 23:08:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c358068-8a2d-4e8e-ad61-a426bddc18a0 tempest-VolumesImageMetadata-801126289 None] Lock "cinder-9f7bffd9-f35b-480b-aa39-77bd1e18be88-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Flow 'volume_create_manager' (b63d711d-dbc4-4727-b9e7-c2ad640bb5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4922e1bd-7c6e-4d87-bff8-e4977e3aa998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4922e1bd-7c6e-4d87-bff8-e4977e3aa998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-802681347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ed17bd-d5de-4693-aebc-d9bcf48cceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fafe03dbb04a66b26781ac6301db5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:32Z,use_quota=True,user_id='2278c922ab564381a627311b7d14963d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ab0e60-b905-48a9-9eb5-d36d4bce70bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ab0e60-b905-48a9-9eb5-d36d4bce70bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428ee46d-6df2-4071-ae1a-4ab36ba93c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428ee46d-6df2-4071-ae1a-4ab36ba93c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ed17bd-d5de-4693-aebc-d9bcf48cceae', 'volume_name': 'volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94f0201-0d9c-4023-ac04-f93ff63b7f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94f0201-0d9c-4023-ac04-f93ff63b7f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdd4441-2437-453f-a199-e4d64a5c2390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Volume e6ed17bd-d5de-4693-aebc-d9bcf48cceae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae', 'volume_size': 1} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-802681347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ed17bd-d5de-4693-aebc-d9bcf48cceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fafe03dbb04a66b26781ac6301db5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:32Z,use_quota=True,user_id='2278c922ab564381a627311b7d14963d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Creating volume e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:32 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:32 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae 1073741824 Sep 11 23:08:32 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Flow 'volume_create_manager' (bc03d423-b572-4ea6-861d-814d3f46a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100248e0-8ca0-4d82-874e-dac78106574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100248e0-8ca0-4d82-874e-dac78106574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-787701348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1cbc4a-eca8-441c-a072-390be128c4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b6b2bbb5b6440687ccbe4738e56b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:33Z,use_quota=True,user_id='b7ba96935f274d8782ed7b1b18e48b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3e81b7-66ae-4a4b-b165-89c22c0d2bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3e81b7-66ae-4a4b-b165-89c22c0d2bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc10230-7894-4817-a83e-3eac9763e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc10230-7894-4817-a83e-3eac9763e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1cbc4a-eca8-441c-a072-390be128c4e1', 'volume_name': 'volume-9d1cbc4a-eca8-441c-a072-390be128c4e1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2b3838-3b95-4338-8c91-3ad742c140de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2b3838-3b95-4338-8c91-3ad742c140de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bcc854-aa1f-4213-9258-822e548d36fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:32 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Volume 9d1cbc4a-eca8-441c-a072-390be128c4e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1cbc4a-eca8-441c-a072-390be128c4e1', 'volume_size': 1} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:32 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae 1073741824" returned: 0 in 0.627s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:32 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:08:32 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:33 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 0.287s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-787701348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1cbc4a-eca8-441c-a072-390be128c4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b6b2bbb5b6440687ccbe4738e56b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:33Z,use_quota=True,user_id='b7ba96935f274d8782ed7b1b18e48b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Creating volume 9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:33 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdd4441-2437-453f-a199-e4d64a5c2390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:33 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 1073741824 Sep 11 23:08:33 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c36d50-3290-4883-834f-0e77d3be4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:33 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Volume volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae (e6ed17bd-d5de-4693-aebc-d9bcf48cceae): created successfully Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c36d50-3290-4883-834f-0e77d3be4103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Flow 'volume_create_manager' (b63d711d-dbc4-4727-b9e7-c2ad640bb5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ad2ed21c-7a17-4b44-a0b5-76a9ae731b6f tempest-VolumesActionsTest-1229800679 None] Created volume successfully. Sep 11 23:08:33 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 1073741824" returned: 0 in 0.584s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:33 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 Sep 11 23:08:33 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:34 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1" returned: 0 in 0.309s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bcc854-aa1f-4213-9258-822e548d36fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1cbc4a-eca8-441c-a072-390be128c4e1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac10b2b-a333-4850-934c-c1d32b70f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Volume volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 (9d1cbc4a-eca8-441c-a072-390be128c4e1): created successfully Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac10b2b-a333-4850-934c-c1d32b70f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Flow 'volume_create_manager' (bc03d423-b572-4ea6-861d-814d3f46a342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1599397d-d3e2-4000-908a-05595e46bb05 tempest-VolumesSnapshotListTestJSON-235211462 None] Created volume successfully. Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Creating offline snapshot a0c9f954-8880-48d2-bc8b-ef3df99fd68b of volume 9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:08:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b90f27-4446-42cb-b553-982205a32709]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:35 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 Sep 11 23:08:35 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:35 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1" returned: 0 in 0.824s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:35 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b 1G Sep 11 23:08:35 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:36 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b 1G" returned: 0 in 0.747s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:36 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b Sep 11 23:08:36 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:37 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b" returned: 0 in 0.582s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:37 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b is being set with open permissions: ugo+rw Sep 11 23:08:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:37 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b Sep 11 23:08:37 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:37 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b" returned: 0 in 0.401s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:37 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.info Sep 11 23:08:37 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:38 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.info" returned: 0 in 0.393s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:38 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.info is being set with open permissions: ugo+rw Sep 11 23:08:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:38 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.info Sep 11 23:08:38 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:38 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.info" returned: 0 in 0.387s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.492s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:38 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-248623db-5610-4a8f-a054-845b013cd3a3 tempest-VolumesSnapshotListTestJSON-235211462 None] Create snapshot completed successfully Sep 11 23:08:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Creating offline snapshot 1456b243-fd1f-4643-ba09-d70ced5c59b2 of volume 9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:08:39 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d548e4-150e-4306-97d4-4cc54e4c6c8b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:39 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b Sep 11 23:08:39 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:40 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b" returned: 0 in 0.841s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1cbc4a-eca8-441c-a072-390be128c4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:40 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 1G Sep 11 23:08:40 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:41 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 1G" returned: 0 in 0.931s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:41 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 Sep 11 23:08:41 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:41 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2" returned: 0 in 0.454s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:41 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 is being set with open permissions: ugo+rw Sep 11 23:08:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:41 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 Sep 11 23:08:41 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2" returned: 0 in 1.206s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:43 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=95,cinder:INSERT=28,cinder:UPDATE=107,cinder:DELETE=9 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.634s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:43 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2f0b10d8-68fa-400c-85b5-8626593beca3 tempest-VolumesSnapshotListTestJSON-235211462 None] Create snapshot completed successfully Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Flow 'volume_create_manager' (e685b78e-2da3-4517-ab93-c8d0efed76a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4023cca-4177-4290-8b42-196a9a6287ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4023cca-4177-4290-8b42-196a9a6287ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2072665316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90af890b-2eeb-4a9a-bbf5-0b2c6130e76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b1fc8c6793419ab774589466eb7c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:44Z,use_quota=True,user_id='d8b194d997b84a01adbcc6904adf9621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4b1741-0ede-46b9-a935-fa7e5ac60f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4b1741-0ede-46b9-a935-fa7e5ac60f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd6f5e7-c945-45dd-9378-a53b290adacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd6f5e7-c945-45dd-9378-a53b290adacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90af890b-2eeb-4a9a-bbf5-0b2c6130e76a', 'volume_name': 'volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1387e51-28e1-48a4-b2a6-84592a62b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1387e51-28e1-48a4-b2a6-84592a62b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a8496b-94c5-4041-a8f9-a839f3e2637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Volume 90af890b-2eeb-4a9a-bbf5-0b2c6130e76a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a', 'volume_size': 1} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2072665316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90af890b-2eeb-4a9a-bbf5-0b2c6130e76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b1fc8c6793419ab774589466eb7c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:44Z,use_quota=True,user_id='d8b194d997b84a01adbcc6904adf9621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Creating volume 90af890b-2eeb-4a9a-bbf5-0b2c6130e76a {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:43 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:08:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:43 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a 1073741824 Sep 11 23:08:43 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:44 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a 1073741824" returned: 0 in 0.948s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:44 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a Sep 11 23:08:44 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:45 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a" returned: 0 in 0.354s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.901s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a8496b-94c5-4041-a8f9-a839f3e2637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16895f26-4b98-4b9f-81f1-a61113d8e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Creating offline snapshot 11d5ede4-2277-47d3-a9d6-61687657af38 of volume 9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:08:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Volume volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a (90af890b-2eeb-4a9a-bbf5-0b2c6130e76a): created successfully Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16895f26-4b98-4b9f-81f1-a61113d8e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Flow 'volume_create_manager' (e685b78e-2da3-4517-ab93-c8d0efed76a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c8ea87-cf3c-4521-8322-b36b8b5a7846]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4c8392e9-48ac-44a3-ad37-c59d7ba51a90 tempest-VolumesTransfersV355Test-354972720 None] Created volume successfully. Sep 11 23:08:45 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 Sep 11 23:08:45 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:46 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2" returned: 0 in 0.685s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1cbc4a-eca8-441c-a072-390be128c4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:46 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 1G Sep 11 23:08:46 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:47 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 1G" returned: 0 in 0.871s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:47 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 Sep 11 23:08:47 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-08833ef6-222f-4862-95aa-81c3a8636910 tempest-VolumesTransfersV355Test-1518654054 None] Transfer volume completed successfully. Sep 11 23:08:47 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38" returned: 0 in 0.727s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:47 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 is being set with open permissions: ugo+rw Sep 11 23:08:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b103a532-15b4-4cd8-9c7f-1451df93e750 tempest-VolumesActionsTest-1229800679 None] Acquiring lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" by "attach_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:47 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 Sep 11 23:08:47 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b103a532-15b4-4cd8-9c7f-1451df93e750 tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" acquired by "attach_volume" :: waited 0.042s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b103a532-15b4-4cd8-9c7f-1451df93e750 tempest-VolumesActionsTest-1229800679 None] Attaching volume e6ed17bd-d5de-4693-aebc-d9bcf48cceae to instance 8f6324ab-cc62-405a-9493-3a1a90b4cc51 at mountpoint /dev/vdb on host None. Sep 11 23:08:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b103a532-15b4-4cd8-9c7f-1451df93e750 tempest-VolumesActionsTest-1229800679 None] Attach volume completed successfully. Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b103a532-15b4-4cd8-9c7f-1451df93e750 tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" released by "attach_volume" :: held 0.197s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-749cb303-9557-4396-bba4-61c27022dcaf tempest-VolumesActionsTest-1229800679 None] Acquiring lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-detach_volume" by "detach_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Acquiring lock "cinder-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-749cb303-9557-4396-bba4-61c27022dcaf tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-detach_volume" acquired by "detach_volume" :: waited 0.070s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-749cb303-9557-4396-bba4-61c27022dcaf tempest-VolumesActionsTest-1229800679 None] Detaching volume e6ed17bd-d5de-4693-aebc-d9bcf48cceae from instance 8f6324ab-cc62-405a-9493-3a1a90b4cc51. Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Lock "cinder-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:48 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38" returned: 0 in 0.788s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Acquiring lock "cinder-quobyte-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Lock "cinder-quobyte-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a" acquired by "delete_volume" :: waited 0.056s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5512e97d-d61b-4696-8738-03b83aa352c9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-749cb303-9557-4396-bba4-61c27022dcaf tempest-VolumesActionsTest-1229800679 None] Detach volume completed successfully. Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-749cb303-9557-4396-bba4-61c27022dcaf tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-detach_volume" released by "detach_volume" :: held 0.262s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d9c62239-f16a-4d97-a02c-7bd0e6101b50 tempest-VolumesSnapshotListTestJSON-235211462 None] Create snapshot completed successfully Sep 11 23:08:48 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a Sep 11 23:08:48 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:49 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a" returned: 0 in 0.545s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:49 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a Sep 11 23:08:49 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:49 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a" returned: 0 in 0.348s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Lock "cinder-quobyte-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a" released by "delete_volume" :: held 0.997s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Created reservations ['bfd07fe4-3fbe-48ad-96f3-53c02d4d1d74', '2713ab0c-1086-41ba-953a-ee9d3132dbad', '1967762d-b172-4330-8852-aec2d1ae0fc2', 'd3435db0-e71a-4f44-be91-1d622b849228'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:49 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:08:49 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:50 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.320s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:50 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Deleted volume successfully. Sep 11 23:08:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7c90ec16-6cfc-4aad-9548-7889d35807a9 tempest-VolumesTransfersV355Test-1513262327 None] Lock "cinder-90af890b-2eeb-4a9a-bbf5-0b2c6130e76a-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-11d5ede4-2277-47d3-a9d6-61687657af38-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-11d5ede4-2277-47d3-a9d6-61687657af38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-quobyte-11d5ede4-2277-47d3-a9d6-61687657af38" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-11d5ede4-2277-47d3-a9d6-61687657af38" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Deleting offline snapshot 11d5ede4-2277-47d3-a9d6-61687657af38 of volume 9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] snapshot_file for this snap is: volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b357dd29-d83a-4dc8-95aa-ce4a0ecdd5e1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:08:51 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 Sep 11 23:08:51 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Flow 'volume_create_manager' (05da5bde-2102-48cc-bf52-f00546c62c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cebfa12-91ef-4e84-9e8a-2d483c9b02d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cebfa12-91ef-4e84-9e8a-2d483c9b02d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1171299189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a45869-ec09-416a-b3ed-fc326bf62cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b1fc8c6793419ab774589466eb7c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:52Z,use_quota=True,user_id='d8b194d997b84a01adbcc6904adf9621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba29fe5c-910c-4e5f-9450-097f905cf69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba29fe5c-910c-4e5f-9450-097f905cf69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73041871-6b7a-4a87-8c23-a1600fe764a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73041871-6b7a-4a87-8c23-a1600fe764a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a45869-ec09-416a-b3ed-fc326bf62cbe', 'volume_name': 'volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed1754b-8998-4dd5-979b-1c751a72f352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed1754b-8998-4dd5-979b-1c751a72f352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab20fc02-b3eb-45fd-80cf-340e693bc90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:51 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Volume b9a45869-ec09-416a-b3ed-fc326bf62cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe', 'volume_size': 1} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1171299189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a45869-ec09-416a-b3ed-fc326bf62cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24b1fc8c6793419ab774589466eb7c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:52Z,use_quota=True,user_id='d8b194d997b84a01adbcc6904adf9621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Creating volume b9a45869-ec09-416a-b3ed-fc326bf62cbe {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:08:51 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:08:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:51 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe 1073741824 Sep 11 23:08:51 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:52 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38" returned: 0 in 0.633s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1cbc4a-eca8-441c-a072-390be128c4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9851732-9704-47c9-b2ae-6aa9639ecd8c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:52 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe 1073741824" returned: 0 in 0.500s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:52 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 Sep 11 23:08:52 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:52 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe Sep 11 23:08:52 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:52 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:52 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe" returned: 0 in 0.285s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2" returned: 0 in 0.446s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1cbc4a-eca8-441c-a072-390be128c4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab20fc02-b3eb-45fd-80cf-340e693bc90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:52 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 Sep 11 23:08:52 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94354ed-c3b2-43f6-96ce-2ce954674b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:08:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Volume volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe (b9a45869-ec09-416a-b3ed-fc326bf62cbe): created successfully Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94354ed-c3b2-43f6-96ce-2ce954674b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:08:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Flow 'volume_create_manager' (05da5bde-2102-48cc-bf52-f00546c62c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:08:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6e5eae84-17c8-4f07-b7aa-0e3be7d4eaae tempest-VolumesTransfersV355Test-354972720 None] Created volume successfully. Sep 11 23:08:53 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38" returned: 0 in 0.437s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:53 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38 Sep 11 23:08:53 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:53 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.11d5ede4-2277-47d3-a9d6-61687657af38" returned: 0 in 0.267s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-11d5ede4-2277-47d3-a9d6-61687657af38" released by "_delete_snapshot" :: held 1.930s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" released by "delete_snapshot" :: held 1.969s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:53 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Created reservations ['00a1ac2c-44a3-49b9-bfc3-631442fd0ba9', '4662f7e8-274f-46fc-a12c-f8afb07ab0b7', 'f4439068-7fcf-4e34-9a29-07ab85f0b1c3', '1d5945a7-b7be-46d3-8ee1-89ab61a8c2e1'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Delete snapshot completed successfully. Sep 11 23:08:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-70e28a78-4ea1-4fa7-8c9f-fca3ea5dbf7b tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-11d5ede4-2277-47d3-a9d6-61687657af38-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Acquiring lock "cinder-b9a45869-ec09-416a-b3ed-fc326bf62cbe-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Lock "cinder-b9a45869-ec09-416a-b3ed-fc326bf62cbe-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Acquiring lock "cinder-quobyte-b9a45869-ec09-416a-b3ed-fc326bf62cbe" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Lock "cinder-quobyte-b9a45869-ec09-416a-b3ed-fc326bf62cbe" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[855a78e8-f528-4bb7-862c-fec52e8bca03]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:54 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe Sep 11 23:08:54 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-1456b243-fd1f-4643-ba09-d70ced5c59b2-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-1456b243-fd1f-4643-ba09-d70ced5c59b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-quobyte-1456b243-fd1f-4643-ba09-d70ced5c59b2" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-1456b243-fd1f-4643-ba09-d70ced5c59b2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Deleting offline snapshot 1456b243-fd1f-4643-ba09-d70ced5c59b2 of volume 9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] snapshot_file for this snap is: volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:54 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe" returned: 0 in 0.496s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6efc00-3579-4c2d-9fc6-db68046773f8]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:54 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe Sep 11 23:08:54 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:54 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 Sep 11 23:08:54 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:55 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9a45869-ec09-416a-b3ed-fc326bf62cbe" returned: 0 in 0.341s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Lock "cinder-quobyte-b9a45869-ec09-416a-b3ed-fc326bf62cbe" released by "delete_volume" :: held 0.886s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Created reservations ['75674c80-742a-4b09-a81b-ecc7060bfa7f', '861bdd88-271f-43e9-98b8-f2e318c42e85', '92819850-ebf4-4f66-b839-4c7c63d51d93', '5766440d-7b8a-4fec-ba20-11e957728b74'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:55 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2" returned: 0 in 0.588s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1cbc4a-eca8-441c-a072-390be128c4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b277de7-a1cb-4254-a4ae-58ac585a36d6]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:55 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:08:55 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:55 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b Sep 11 23:08:55 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:55 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.393s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:08:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Deleted volume successfully. Sep 11 23:08:55 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-381027fe-3225-403a-ba07-c09a55c52ab4 tempest-VolumesTransfersV355Test-1513262327 None] Lock "cinder-b9a45869-ec09-416a-b3ed-fc326bf62cbe-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b" returned: 0 in 0.495s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1cbc4a-eca8-441c-a072-390be128c4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:56 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 Sep 11 23:08:56 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:56 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2" returned: 0 in 0.470s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:56 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2 Sep 11 23:08:56 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:56 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.1456b243-fd1f-4643-ba09-d70ced5c59b2" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-1456b243-fd1f-4643-ba09-d70ced5c59b2" released by "_delete_snapshot" :: held 2.087s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" released by "delete_snapshot" :: held 2.137s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:57 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Created reservations ['7a990f6f-cdc0-4d64-9de4-5d88a506b3fa', 'faa01d95-fe97-49ee-bead-42b96795c23a', 'b532885c-0a63-4ef4-8742-6e6a19a371bb', 'feb07bed-2430-4c3a-84f9-19c7d6d05e67'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:08:57 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Delete snapshot completed successfully. Sep 11 23:08:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55aff7b3-48bb-4635-adc3-4069c01c257a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-1456b243-fd1f-4643-ba09-d70ced5c59b2-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-a0c9f954-8880-48d2-bc8b-ef3df99fd68b-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-a0c9f954-8880-48d2-bc8b-ef3df99fd68b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-quobyte-a0c9f954-8880-48d2-bc8b-ef3df99fd68b" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-a0c9f954-8880-48d2-bc8b-ef3df99fd68b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Deleting offline snapshot a0c9f954-8880-48d2-bc8b-ef3df99fd68b of volume 9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] snapshot_file for this snap is: volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f9937-ce63-47ff-8b9b-a5ed9501bc39]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:58 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b Sep 11 23:08:58 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:58 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b" returned: 0 in 0.484s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1cbc4a-eca8-441c-a072-390be128c4e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f327747-015a-4827-9e19-004f499d79ed]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:08:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:58 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 Sep 11 23:08:58 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:59 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1" returned: 0 in 0.496s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:08:59 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b Sep 11 23:08:59 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:08:59 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 11 23:08:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b" returned: 0 in 0.760s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:08:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:00 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b Sep 11 23:09:00 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:00 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1.a0c9f954-8880-48d2-bc8b-ef3df99fd68b" returned: 0 in 0.583s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-a0c9f954-8880-48d2-bc8b-ef3df99fd68b" released by "_delete_snapshot" :: held 2.473s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" released by "delete_snapshot" :: held 2.507s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:00 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Created reservations ['51e3b760-22bc-49d4-9d7f-43604897cb02', '92e64750-6db7-4483-a7ad-5fd08ba5498f', '6b4c7b9f-adc0-4615-915a-94e687997d58', 'e29e0558-e386-4ac8-8aae-1e1e6c1eef36'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Delete snapshot completed successfully. Sep 11 23:09:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-58697736-f8ad-44e7-b50a-36cfb032fd5a tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-a0c9f954-8880-48d2-bc8b-ef3df99fd68b-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-9d1cbc4a-eca8-441c-a072-390be128c4e1-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-9d1cbc4a-eca8-441c-a072-390be128c4e1-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" acquired by "delete_volume" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[62880430-6c74-4007-8218-6b3c12243682]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:02 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 Sep 11 23:09:02 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:02 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1" returned: 0 in 0.694s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:02 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1 Sep 11 23:09:02 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:03 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9d1cbc4a-eca8-441c-a072-390be128c4e1" returned: 0 in 0.485s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-quobyte-9d1cbc4a-eca8-441c-a072-390be128c4e1" released by "delete_volume" :: held 1.290s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Created reservations ['4b3a6299-63ee-4572-be5b-bdb03f496527', '0a9d1684-f585-42d8-b669-58f7607bac34', 'c736903b-7b6a-4d41-878e-287eaaa3d4bf', 'd89c42ef-97ba-4be9-8339-5d808fb0da9a'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:03 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:09:03 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c95ba519-739d-401f-94a0-bbac71987a3b tempest-VolumesActionsTest-1229800679 None] Acquiring lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" by "attach_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c95ba519-739d-401f-94a0-bbac71987a3b tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" acquired by "attach_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c95ba519-739d-401f-94a0-bbac71987a3b tempest-VolumesActionsTest-1229800679 None] Attaching volume e6ed17bd-d5de-4693-aebc-d9bcf48cceae to instance 3ad39ff3-9a79-4ed4-95c9-5249a33df94c at mountpoint /dev/vdb on host None. Sep 11 23:09:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c95ba519-739d-401f-94a0-bbac71987a3b tempest-VolumesActionsTest-1229800679 None] Attach volume completed successfully. Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c95ba519-739d-401f-94a0-bbac71987a3b tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" released by "attach_volume" :: held 0.184s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:03 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.471s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Deleted volume successfully. Sep 11 23:09:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1231a89a-1055-458b-97af-c7e7cd755385 tempest-VolumesSnapshotListTestJSON-235211462 None] Lock "cinder-9d1cbc4a-eca8-441c-a072-390be128c4e1-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9649967a-c070-4a50-9c5a-09e197dbf5bb tempest-VolumesActionsTest-1229800679 None] Acquiring lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-detach_volume" by "detach_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9649967a-c070-4a50-9c5a-09e197dbf5bb tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-9649967a-c070-4a50-9c5a-09e197dbf5bb tempest-VolumesActionsTest-1229800679 None] Detaching volume e6ed17bd-d5de-4693-aebc-d9bcf48cceae from instance 3ad39ff3-9a79-4ed4-95c9-5249a33df94c. Sep 11 23:09:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-9649967a-c070-4a50-9c5a-09e197dbf5bb tempest-VolumesActionsTest-1229800679 None] Detach volume completed successfully. Sep 11 23:09:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9649967a-c070-4a50-9c5a-09e197dbf5bb tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:10 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:INSERT=34,cinder:UPDATE=108,cinder:SELECT=95,cinder:DELETE=8 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:09:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:10 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06cf4b4-6e9c-4bba-9d5b-90bbaea4d9ea]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:11 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:09:11 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:11 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:09:11 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:11 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 0.688s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfcb78a-fa25-41f4-9ecc-f1d7c7e33ab6]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:11 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.424s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:11 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:09:11 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:09:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:09:12 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 0.537s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.2fb35ec8-2a3c-41f0-b8d9-478a15d17a11ajoc8tcu.img {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:12 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.2fb35ec8-2a3c-41f0-b8d9-478a15d17a11ajoc8tcu.img Sep 11 23:09:12 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Flow 'volume_create_manager' (1899aa41-e182-457c-8323-eeae6ad392f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00066b2e-ea08-457e-bdad-8e6d236ffc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00066b2e-ea08-457e-bdad-8e6d236ffc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-695428483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184e1fcb-9a26-4668-bf3c-ba7ce748f1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2410f217bb994babba6039e4f86db050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:13Z,use_quota=True,user_id='1935359b361d41e191a0bf6b82160ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611e7d82-8fc9-4087-aa1c-9c081c26064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611e7d82-8fc9-4087-aa1c-9c081c26064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0b569a-ad25-4865-ab6d-fc53dd61203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0b569a-ad25-4865-ab6d-fc53dd61203b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184e1fcb-9a26-4668-bf3c-ba7ce748f1a4', 'volume_name': 'volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4', 'volume_size': 2}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf101f67-4fe7-4156-bdaf-79e4f164828c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf101f67-4fe7-4156-bdaf-79e4f164828c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642e8aee-a8b0-4826-bf71-16be0ce7e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Volume 184e1fcb-9a26-4668-bf3c-ba7ce748f1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4', 'volume_size': 2} Sep 11 23:09:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-923bbee8-22d3-41ac-9cd8-363969418000 req-652afe41-3efc-4608-9537-02200cd747d9 tempest-AttachVolumeNegativeTest-1722998956 None] Terminate volume connection completed successfully. Sep 11 23:09:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-923bbee8-22d3-41ac-9cd8-363969418000 req-652afe41-3efc-4608-9537-02200cd747d9 tempest-AttachVolumeNegativeTest-1722998956 None] Deleting attachment 2b2c53b6-932a-4542-ae5c-65c572a2edd7. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:09:18 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.2fb35ec8-2a3c-41f0-b8d9-478a15d17a11ajoc8tcu.img" returned: 0 in 5.881s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:18 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e27e67b-2c27-4ff2-9b69-e9f460566234]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:18 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:09:18 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:18 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 0.659s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:18 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.2fb35ec8-2a3c-41f0-b8d9-478a15d17a11ajoc8tcu.img {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:09:18 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Converted 1024.00 MB image at 174.08 MB/s Sep 11 23:09:18 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] 2fb35ec8-2a3c-41f0-b8d9-478a15d17a11 was raw, no need to convert to raw {{(pid=88026) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 11 23:09:28 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:09:28 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:DELETE=4,cinder:SELECT=55,cinder:UPDATE=54,cinder:INSERT=14 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.701s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Uploaded volume to glance image-id: 2fb35ec8-2a3c-41f0-b8d9-478a15d17a11. {{(pid=88026) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.326s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-695428483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184e1fcb-9a26-4668-bf3c-ba7ce748f1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2410f217bb994babba6039e4f86db050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:13Z,use_quota=True,user_id='1935359b361d41e191a0bf6b82160ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Creating volume 184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:09:48 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:09:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 2147483648 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-14adc95a-ed15-4b52-8465-0bdffba10891 tempest-VolumesActionsTest-1229800679 None] Copy volume to image completed successfully. Sep 11 23:09:48 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 2147483648 Sep 11 23:09:48 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:49 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 2147483648" returned: 0 in 0.708s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:49 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 Sep 11 23:09:49 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:49 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" returned: 0 in 0.261s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642e8aee-a8b0-4826-bf71-16be0ce7e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4', 'volume_size': 2}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e58336-973a-4f1f-bd8a-aaabd04a3747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:09:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Volume volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 (184e1fcb-9a26-4668-bf3c-ba7ce748f1a4): created successfully Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e58336-973a-4f1f-bd8a-aaabd04a3747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:09:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Flow 'volume_create_manager' (1899aa41-e182-457c-8323-eeae6ad392f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:09:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d41c8bee-640e-4e8b-84b0-57f3dbf85402 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Created volume successfully. Sep 11 23:09:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Creating offline snapshot 7757ca9f-7756-4607-98e1-654784e82aca of volume 184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:09:50 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a38a2fa-0384-4ab3-9453-36bd070bcc7f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:50 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 Sep 11 23:09:50 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:09:50 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" returned: 0 in 0.446s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca 2G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:50 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca 2G Sep 11 23:09:50 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:51 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca 2G" returned: 0 in 0.475s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:51 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca Sep 11 23:09:51 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:51 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca" returned: 0 in 0.348s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:51 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca is being set with open permissions: ugo+rw Sep 11 23:09:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:51 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca Sep 11 23:09:51 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:52 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca" returned: 0 in 0.326s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:52 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.info Sep 11 23:09:52 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:52 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.info" returned: 0 in 0.311s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:52 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.info is being set with open permissions: ugo+rw Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:52 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.info Sep 11 23:09:52 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:52 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.info" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[790deff3-8a16-434c-9f91-979585df5702]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ae3e878f-714a-41f0-a68b-ac21b50c6064 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Create snapshot completed successfully Sep 11 23:09:52 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:09:52 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:53 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 0.517s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1632a291-cf54-4007-8ca2-703b46c850c5]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:53 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:09:53 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "cinder-7757ca9f-7756-4607-98e1-654784e82aca-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-7757ca9f-7756-4607-98e1-654784e82aca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "cinder-quobyte-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-quobyte-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "cinder-quobyte-7757ca9f-7756-4607-98e1-654784e82aca" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-quobyte-7757ca9f-7756-4607-98e1-654784e82aca" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Deleting offline snapshot 7757ca9f-7756-4607-98e1-654784e82aca of volume 184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] snapshot_file for this snap is: volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae5172-d7c5-4d9e-ab4a-a4c546e85a2e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:53 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 0.682s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:54 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img Sep 11 23:09:54 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:54 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca Sep 11 23:09:54 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:54 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca" returned: 0 in 0.525s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:09:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[469dacb1-3289-4672-9c56-5834334bbb9e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:54 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 Sep 11 23:09:54 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:55 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" returned: 0 in 1.110s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:55 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca Sep 11 23:09:55 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:56 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca" returned: 0 in 0.957s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:56 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca Sep 11 23:09:56 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:09:57 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 11 23:09:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4.7757ca9f-7756-4607-98e1-654784e82aca" returned: 0 in 0.796s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:09:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-quobyte-7757ca9f-7756-4607-98e1-654784e82aca" released by "_delete_snapshot" :: held 3.703s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-quobyte-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" released by "delete_snapshot" :: held 3.755s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:57 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Created reservations ['9b94d459-d36f-45e6-8ee8-0b81f05c99da', 'bf033437-9a22-4db3-90bf-29ebf20a90da', '0b25e6bd-5ca1-417f-bf7a-423154e870d8', 'dad990db-f9a8-436a-befa-f300009cc90d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:09:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Delete snapshot completed successfully. Sep 11 23:09:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9d3ea38c-aa02-45b4-8710-0151c4835b7f tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-7757ca9f-7756-4607-98e1-654784e82aca-delete_snapshot" released by "delete_snapshot" :: held 4.294s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:09:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "cinder-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "cinder-quobyte-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:09:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-quobyte-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" acquired by "delete_volume" :: waited 0.049s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:09:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c59df38-daf3-4211-835a-5ed071abfc60]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:09:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:09:59 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 Sep 11 23:09:59 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:00 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" returned: 0 in 1.259s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:00 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4 Sep 11 23:10:00 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:01 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img" returned: 0 in 7.329s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[375cbdde-3254-4de1-8f3b-54b24d502e4b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:01 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" returned: 0 in 0.670s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-quobyte-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4" released by "delete_volume" :: held 2.254s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:01 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:10:01 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:01 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Created reservations ['3a5ba073-9651-471f-aa47-ff6fd0ba200f', '82da6f98-a9d0-4e53-a3c1-2f779604fe4c', '71545162-dfc9-496a-a6eb-b3321319d7f1', '3d1ae888-df12-4b26-986c-422adb43d91a'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:02 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:10:02 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:02 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 1.061s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:10:02 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Converted 1024.00 MB image at 139.69 MB/s Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] c2cd44ba-bd6b-4857-a15c-f859e06db6bd was raw, converting to qcow2 {{(pid=88026) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[639a0ecf-a406-4805-9fac-f1d285e69730]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:02 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Flow 'volume_create_manager' (d81cc1cf-4f52-4119-89f1-4d3e0c32c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:02 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9684712f-4526-4026-bfe2-15aaf27f8245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:02 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.653s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Deleted volume successfully. Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9684712f-4526-4026-bfe2-15aaf27f8245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1978537342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92103d0-88e8-413d-8685-ea34fe36cdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac8e3f15213407fa3da00033dad9719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:03Z,use_quota=True,user_id='ce25c25587c443e3bfa7013bb62276e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a3db9c-00ff-4c25-8192-0d65b541dd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a3db9c-00ff-4c25-8192-0d65b541dd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9ebf88-67bb-4821-932c-92aae99d6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9ebf88-67bb-4821-932c-92aae99d6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e92103d0-88e8-413d-8685-ea34fe36cdb3', 'volume_name': 'volume-e92103d0-88e8-413d-8685-ea34fe36cdb3', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d804df2-44f3-42b1-94c8-12a3f6ae04b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d804df2-44f3-42b1-94c8-12a3f6ae04b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30d360d-2ca7-4bf8-b777-299d4dcca3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:02 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Volume e92103d0-88e8-413d-8685-ea34fe36cdb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e92103d0-88e8-413d-8685-ea34fe36cdb3', 'volume_size': 1} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-768c8fb1-2124-4caf-939b-92a438a475d9 tempest-VolumesSnapshotNegativeTestJSON-1760334929 None] Lock "cinder-184e1fcb-9a26-4668-bf3c-ba7ce748f1a4-delete_volume" released by "delete_volume" :: held 3.877s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:03 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img" returned: 0 in 0.527s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:03 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img Sep 11 23:10:03 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:03 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img" returned: 1 in 0.553s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img /opt/stack/data/cinder/conversion/vol_upload_uqh05l8i {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:03 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img /opt/stack/data/cinder/conversion/vol_upload_uqh05l8i Sep 11 23:10:03 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:03 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img /opt/stack/data/cinder/conversion/vol_upload_uqh05l8i" returned: 0 in 0.328s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Image conversion details: src /opt/stack/data/cinder/conversion/e6ed17bd-d5de-4693-aebc-d9bcf48cceae.temp_image.c2cd44ba-bd6b-4857-a15c-f859e06db6bdp6lvkcut.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_uqh05l8i {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:10:03 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba210c5-486c-4527-93d3-9c8e74537cda]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uqh05l8i {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:04 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uqh05l8i Sep 11 23:10:04 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:04 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uqh05l8i" returned: 0 in 0.533s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Flow 'volume_create_manager' (69631c0a-b81c-42a8-8541-9f35970e1268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb286cbb-9778-433f-b4fb-1f55261e25d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb286cbb-9778-433f-b4fb-1f55261e25d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123425866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a57886-1336-49f5-94bc-ea661c7b0454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c309fe982b4fcca3a4fbb8d7e9d732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:05Z,use_quota=True,user_id='f97ea418d21b45f0b60c3c7e8c4d181f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8526bde5-3761-4a34-88f5-402ea9cbc159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8526bde5-3761-4a34-88f5-402ea9cbc159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d1b7e8-ca16-4132-8fd1-9719da611665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d1b7e8-ca16-4132-8fd1-9719da611665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a57886-1336-49f5-94bc-ea661c7b0454', 'volume_name': 'volume-39a57886-1336-49f5-94bc-ea661c7b0454', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6e623b-8c15-4a1a-abf6-5bb12910f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6e623b-8c15-4a1a-abf6-5bb12910f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf6b09b-6fbf-405b-a08a-6d5f040feb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:05 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Volume 39a57886-1336-49f5-94bc-ea661c7b0454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a57886-1336-49f5-94bc-ea661c7b0454', 'volume_size': 1} Sep 11 23:10:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.881s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Uploaded volume to glance image-id: c2cd44ba-bd6b-4857-a15c-f859e06db6bd. {{(pid=88026) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.817s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1978537342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92103d0-88e8-413d-8685-ea34fe36cdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac8e3f15213407fa3da00033dad9719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:03Z,use_quota=True,user_id='ce25c25587c443e3bfa7013bb62276e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Creating volume e92103d0-88e8-413d-8685-ea34fe36cdb3 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:06 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:10:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-82efd1f5-cbb5-4fe8-99ec-a1c98cd20c13 tempest-VolumesActionsTest-1229800679 None] Copy volume to image completed successfully. Sep 11 23:10:06 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 1073741824 Sep 11 23:10:06 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 1073741824" returned: 0 in 0.628s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:07 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:07 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 Sep 11 23:10:07 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:07 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3" returned: 0 in 0.439s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.363s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-123425866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a57886-1336-49f5-94bc-ea661c7b0454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c309fe982b4fcca3a4fbb8d7e9d732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:05Z,use_quota=True,user_id='f97ea418d21b45f0b60c3c7e8c4d181f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Creating volume 39a57886-1336-49f5-94bc-ea661c7b0454 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:07 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30d360d-2ca7-4bf8-b777-299d4dcca3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92103d0-88e8-413d-8685-ea34fe36cdb3', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a99302-1df3-46ef-9899-56f663443b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:07 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 1073741824 Sep 11 23:10:07 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:07 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Volume volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 (e92103d0-88e8-413d-8685-ea34fe36cdb3): created successfully Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a99302-1df3-46ef-9899-56f663443b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Flow 'volume_create_manager' (d81cc1cf-4f52-4119-89f1-4d3e0c32c930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:07 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7a149112-8b96-40eb-a1a2-fd094993f4fe tempest-AttachVolumeNegativeTest-1722998956 None] Created volume successfully. Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Acquiring lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Acquiring lock "cinder-quobyte-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Lock "cinder-quobyte-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcbf52a-8464-4c1d-8cd5-d571ff0dde2d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:08 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:10:08 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:08 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 1073741824" returned: 0 in 0.834s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:08 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 0.516s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:08 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 Sep 11 23:10:08 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:08 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae Sep 11 23:10:08 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:09 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454" returned: 0 in 0.344s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf6b09b-6fbf-405b-a08a-6d5f040feb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a57886-1336-49f5-94bc-ea661c7b0454', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caffe90-bd8e-4231-b5d1-ae359ed9cead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:09 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Volume volume-39a57886-1336-49f5-94bc-ea661c7b0454 (39a57886-1336-49f5-94bc-ea661c7b0454): created successfully Sep 11 23:10:09 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7caffe90-bd8e-4231-b5d1-ae359ed9cead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Flow 'volume_create_manager' (69631c0a-b81c-42a8-8541-9f35970e1268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" returned: 0 in 0.423s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Lock "cinder-quobyte-e6ed17bd-d5de-4693-aebc-d9bcf48cceae" released by "delete_volume" :: held 1.004s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b024a495-571a-4c2a-8223-ee368413b3a7 tempest-TestMinimumBasicScenario-1351515901 None] Created volume successfully. Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Created reservations ['af6c0cd9-4976-4edf-9712-bf91376a06d0', 'c6331a85-dcf9-4ccc-a970-93b1fcc758e5', 'd9292070-7840-4502-a025-3d784bc6728e', 'a7ac2a37-cfd6-43de-b74b-b38bd36f6b44'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:09 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:10:09 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:09 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.407s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Deleted volume successfully. Sep 11 23:10:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4f73ea31-b986-425a-ad2b-c031cdbc3a33 tempest-VolumesActionsTest-1229800679 None] Lock "cinder-e6ed17bd-d5de-4693-aebc-d9bcf48cceae-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-fe71b268-11e1-4a10-a529-28039ac95424 req-a1e9e177-391e-46de-a85f-9bb021161515 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-fe71b268-11e1-4a10-a529-28039ac95424 req-a1e9e177-391e-46de-a85f-9bb021161515 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-fe71b268-11e1-4a10-a529-28039ac95424 req-a1e9e177-391e-46de-a85f-9bb021161515 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-fe71b268-11e1-4a10-a529-28039ac95424 req-a1e9e177-391e-46de-a85f-9bb021161515 tempest-AttachVolumeNegativeTest-1722998956 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-e92103d0-88e8-413d-8685-ea34fe36cdb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37678756-0136-41c3-8425-d1192a8ce835', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:10:10 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-fe71b268-11e1-4a10-a529-28039ac95424 req-a1e9e177-391e-46de-a85f-9bb021161515 tempest-AttachVolumeNegativeTest-1722998956 None] attachment_update completed successfully. Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:11 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:10:11 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-bd6123b3-dedc-4c9b-8a67-e799f0d6db69 req-75394af1-af2b-45c5-a5eb-3d84187b0852 tempest-TestMinimumBasicScenario-1351515901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-bd6123b3-dedc-4c9b-8a67-e799f0d6db69 req-75394af1-af2b-45c5-a5eb-3d84187b0852 tempest-TestMinimumBasicScenario-1351515901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-bd6123b3-dedc-4c9b-8a67-e799f0d6db69 req-75394af1-af2b-45c5-a5eb-3d84187b0852 tempest-TestMinimumBasicScenario-1351515901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-bd6123b3-dedc-4c9b-8a67-e799f0d6db69 req-75394af1-af2b-45c5-a5eb-3d84187b0852 tempest-TestMinimumBasicScenario-1351515901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-39a57886-1336-49f5-94bc-ea661c7b0454', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc17fbce-b104-40dc-8dc9-8ac2c2f862db', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:10:11 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-bd6123b3-dedc-4c9b-8a67-e799f0d6db69 req-75394af1-af2b-45c5-a5eb-3d84187b0852 tempest-TestMinimumBasicScenario-1351515901 None] attachment_update completed successfully. Sep 11 23:10:11 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.550s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:12 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:10:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:10:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:10:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-f19685c6-8a45-4ea6-ba68-c1f032f1d785 req-abce36c2-3b73-43af-bb2a-6f31eeb75aa1 tempest-AttachVolumeNegativeTest-1722998956 None] Terminate volume connection completed successfully. Sep 11 23:10:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-f19685c6-8a45-4ea6-ba68-c1f032f1d785 req-abce36c2-3b73-43af-bb2a-6f31eeb75aa1 tempest-AttachVolumeNegativeTest-1722998956 None] Deleting attachment 37678756-0136-41c3-8425-d1192a8ce835. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:10:21 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=38,cinder:SELECT=36,cinder:INSERT=8,cinder:DELETE=5 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:10:24 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=45,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:10:27 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Flow 'volume_create_manager' (98620c4f-5150-4586-8315-b0651be72dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4029af-8a8a-489b-8166-a79d4fbf7c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4029af-8a8a-489b-8166-a79d4fbf7c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1586559417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72fd2ef-d537-43ec-ae9e-58d0cb5c7544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f85ba7e68b459bb7f20547b157a31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:28Z,use_quota=True,user_id='ff27d8a54ca54b0caf2609c50c8fbb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23b51c2-2a06-4598-8ef2-fcd79c148b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23b51c2-2a06-4598-8ef2-fcd79c148b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:27 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e305c267-605f-45da-822d-aad99fbe2390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e305c267-605f-45da-822d-aad99fbe2390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f72fd2ef-d537-43ec-ae9e-58d0cb5c7544', 'volume_name': 'volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5047f6d4-5f14-4811-befe-4d7df8b52824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5047f6d4-5f14-4811-befe-4d7df8b52824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93cd612-ed9e-4536-a20b-ff120c62eac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:28 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Volume f72fd2ef-d537-43ec-ae9e-58d0cb5c7544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544', 'volume_size': 1} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1586559417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72fd2ef-d537-43ec-ae9e-58d0cb5c7544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f85ba7e68b459bb7f20547b157a31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:28Z,use_quota=True,user_id='ff27d8a54ca54b0caf2609c50c8fbb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Creating volume f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:10:28 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:28 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 1073741824 Sep 11 23:10:28 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:28 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 1073741824" returned: 0 in 0.551s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:28 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 Sep 11 23:10:28 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:28 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" returned: 0 in 0.361s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:10:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f93cd612-ed9e-4536-a20b-ff120c62eac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd5e82f-a0c7-4de3-91ce-7d63a805b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:29 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Volume volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 (f72fd2ef-d537-43ec-ae9e-58d0cb5c7544): created successfully Sep 11 23:10:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd5e82f-a0c7-4de3-91ce-7d63a805b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Flow 'volume_create_manager' (98620c4f-5150-4586-8315-b0651be72dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-eb32c9b3-59ce-45d7-9da0-c047aeba9f75 tempest-VolumesCloneTest-1017773368 None] Created volume successfully. Sep 11 23:10:30 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:10:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Flow 'volume_create_manager' (3f33af68-6af5-438f-b303-4a7c490de43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4e533d-6c96-4713-bcf1-fadd7cfe240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4e533d-6c96-4713-bcf1-fadd7cfe240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-875042231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4024cecf-1581-4ce5-a432-dbe4d4f505d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f85ba7e68b459bb7f20547b157a31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f72fd2ef-d537-43ec-ae9e-58d0cb5c7544,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:31Z,use_quota=True,user_id='ff27d8a54ca54b0caf2609c50c8fbb84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85f8f83-b538-436c-913f-5221b47a8143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85f8f83-b538-436c-913f-5221b47a8143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d175fb5-00ad-401f-b1a7-595e9247deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d175fb5-00ad-401f-b1a7-595e9247deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4024cecf-1581-4ce5-a432-dbe4d4f505d3', 'volume_name': 'volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3', 'volume_size': 2, 'source_volid': 'f72fd2ef-d537-43ec-ae9e-58d0cb5c7544', 'source_volstatus': 'available'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5eecdd-2841-445a-9f93-b5f883cbae31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5eecdd-2841-445a-9f93-b5f883cbae31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff70c1ac-6744-4952-a575-9b52a8ebd647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:31 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Volume 4024cecf-1581-4ce5-a432-dbe4d4f505d3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3', 'volume_size': 2, 'source_volid': 'f72fd2ef-d537-43ec-ae9e-58d0cb5c7544', 'source_volstatus': 'available'} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:31 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Cloning volume f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 to volume 4024cecf-1581-4ce5-a432-dbe4d4f505d3 Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Creating offline snapshot 5cda6e26-06e3-48e5-bccd-0fe04997e69e of volume f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4e83ba-cc4e-4396-a8ec-d588357953aa]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:31 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 Sep 11 23:10:31 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:31 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" returned: 0 in 0.452s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:31 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e 1G Sep 11 23:10:31 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:32 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e 1G" returned: 0 in 0.682s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:32 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e Sep 11 23:10:32 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:32 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e" returned: 0 in 0.461s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:32 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e is being set with open permissions: ugo+rw Sep 11 23:10:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:32 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e Sep 11 23:10:32 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:33 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e" returned: 0 in 0.399s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:33 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.info Sep 11 23:10:33 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:33 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.info" returned: 0 in 0.384s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:33 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.info is being set with open permissions: ugo+rw Sep 11 23:10:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:33 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.info Sep 11 23:10:33 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:34 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.info" returned: 0 in 0.415s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "cinder-quobyte-4024cecf-1581-4ce5-a432-dbe4d4f505d3" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-quobyte-4024cecf-1581-4ce5-a432-dbe4d4f505d3" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] snapshot: 5cda6e26-06e3-48e5-bccd-0fe04997e69e, volume: 4024cecf-1581-4ce5-a432-dbe4d4f505d3, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bdcb37-e900-41e7-938a-e65b91a4f5bd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:34 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e Sep 11 23:10:34 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:34 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e" returned: 0 in 0.632s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f961195-3c21-489e-aafb-e77223f382d5]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:35 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 Sep 11 23:10:35 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:35 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" returned: 0 in 0.696s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:10:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:10:35 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:10:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:35 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 Sep 11 23:10:35 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:42 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3" returned: 0 in 6.613s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:10:42 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Converted 1024.00 MB image at 154.82 MB/s Sep 11 23:10:42 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 is being set with open permissions: ugo+rw Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:42 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 Sep 11 23:10:42 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:42 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3" returned: 0 in 0.336s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-quobyte-4024cecf-1581-4ce5-a432-dbe4d4f505d3" released by "_copy_volume_from_snapshot" :: held 8.426s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "cinder-quobyte-5cda6e26-06e3-48e5-bccd-0fe04997e69e" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-quobyte-5cda6e26-06e3-48e5-bccd-0fe04997e69e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Deleting offline snapshot 5cda6e26-06e3-48e5-bccd-0fe04997e69e of volume f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] snapshot_file for this snap is: volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce51c10c-fb09-4bb6-aec2-d3f67ef53721]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:42 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e Sep 11 23:10:42 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:43 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e" returned: 0 in 0.458s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:10:43 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45064123-5775-418f-8371-a151fc8ddf98]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:43 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=2 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:10:43 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 Sep 11 23:10:43 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:43 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" returned: 0 in 0.741s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:43 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e Sep 11 23:10:43 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:44 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e" returned: 0 in 0.695s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:44 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e Sep 11 23:10:44 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:45 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544.5cda6e26-06e3-48e5-bccd-0fe04997e69e" returned: 0 in 0.576s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-quobyte-5cda6e26-06e3-48e5-bccd-0fe04997e69e" released by "_delete_snapshot" :: held 2.629s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.307s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff70c1ac-6744-4952-a575-9b52a8ebd647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3', 'volume_size': 2, 'source_volid': 'f72fd2ef-d537-43ec-ae9e-58d0cb5c7544', 'source_volstatus': 'available'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d79bcb-ced8-4e6a-a0e5-24514789a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:10:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Volume volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 (4024cecf-1581-4ce5-a432-dbe4d4f505d3): created successfully Sep 11 23:10:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d79bcb-ced8-4e6a-a0e5-24514789a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:10:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Flow 'volume_create_manager' (3f33af68-6af5-438f-b303-4a7c490de43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:10:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e216557a-4238-44c7-8023-913418ddab10 tempest-VolumesCloneTest-1017773368 None] Created volume successfully. Sep 11 23:10:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "cinder-4024cecf-1581-4ce5-a432-dbe4d4f505d3-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-4024cecf-1581-4ce5-a432-dbe4d4f505d3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "cinder-quobyte-4024cecf-1581-4ce5-a432-dbe4d4f505d3" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-quobyte-4024cecf-1581-4ce5-a432-dbe4d4f505d3" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9853ead-40b9-4af9-801a-789cde4570af]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:46 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 Sep 11 23:10:46 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:47 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3" returned: 0 in 0.608s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:47 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3 Sep 11 23:10:47 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:47 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4024cecf-1581-4ce5-a432-dbe4d4f505d3" returned: 0 in 0.324s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-quobyte-4024cecf-1581-4ce5-a432-dbe4d4f505d3" released by "delete_volume" :: held 1.013s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Created reservations ['1ad9f3ad-40e0-4832-9910-56c0a45dd22e', '412955ad-a3ed-4872-8d20-ea412ddbf864', 'c9bb42fc-dd3d-4872-9ac4-3bbdc3db342c', 'df37d7fd-8048-47af-b42a-1c4414bb5704'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:48 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:10:48 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:48 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.411s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:48 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Deleted volume successfully. Sep 11 23:10:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-40483e3f-9697-41a8-937d-68bb74902db8 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-4024cecf-1581-4ce5-a432-dbe4d4f505d3-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "cinder-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "cinder-quobyte-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:10:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-quobyte-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" acquired by "delete_volume" :: waited 0.039s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:10:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[435d6a2c-142b-4caf-937e-0b896b648f54]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:10:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:49 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 Sep 11 23:10:49 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:50 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" returned: 0 in 0.619s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:50 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544 Sep 11 23:10:50 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:50 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" returned: 0 in 0.516s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-quobyte-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544" released by "delete_volume" :: held 1.255s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Created reservations ['8359590d-f775-4b4d-b825-7b2fb409230c', '5bfc90b5-725c-4a24-9b53-c04b896324dc', '68ba0f7e-ab0b-4a15-8f9f-e8c52c72d88b', 'b89cb06c-70d8-46fa-8e68-fda7c612d3d8'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:10:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:10:50 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:10:50 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:10:51 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Sep 11 23:10:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.428s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:10:51 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:10:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Deleted volume successfully. Sep 11 23:10:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-204d10ef-473a-4e56-9f84-2eec66bf8a71 tempest-VolumesCloneTest-1017773368 None] Lock "cinder-f72fd2ef-d537-43ec-ae9e-58d0cb5c7544-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Flow 'volume_create_manager' (b464f423-0168-41ea-9921-0cdf61aa4b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a31b8-b2f6-484f-b93d-f735b9398976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a31b8-b2f6-484f-b93d-f735b9398976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1390194251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77440bd3-d264-447f-aba8-441b0071c4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a5c5e644c4e6e8bc6f9d5855cc596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:00Z,use_quota=True,user_id='ad083e7bca1d46bb9158381e20984f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f404a670-02e5-495a-a908-28ac0aa2e23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f404a670-02e5-495a-a908-28ac0aa2e23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff4bde0-e4c5-41e6-8eaa-358163bc48f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:11:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff4bde0-e4c5-41e6-8eaa-358163bc48f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77440bd3-d264-447f-aba8-441b0071c4d8', 'volume_name': 'volume-77440bd3-d264-447f-aba8-441b0071c4d8', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eded063-1f71-46cf-8f97-3d90746a5b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eded063-1f71-46cf-8f97-3d90746a5b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b815cea6-ec1e-4587-bf66-5d269683e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:01 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Volume 77440bd3-d264-447f-aba8-441b0071c4d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77440bd3-d264-447f-aba8-441b0071c4d8', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:11:01 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Trying to clone 77440bd3-d264-447f-aba8-441b0071c4d8 from image 30dc07db-5049-43e5-a274-fa94fe6ac71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:11:01 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:11:01 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:11:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e39deac-bcc0-4a15-9681-3c966cb8f4b3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:01 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD Sep 11 23:11:01 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:02 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d is fetched for user ad083e7bca1d46bb9158381e20984f3b. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86bb266-72a5-4b25-b4ec-a48923248350]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:02 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD Sep 11 23:11:02 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:02 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1390194251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77440bd3-d264-447f-aba8-441b0071c4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a5c5e644c4e6e8bc6f9d5855cc596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:00Z,use_quota=True,user_id='ad083e7bca1d46bb9158381e20984f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Creating volume 77440bd3-d264-447f-aba8-441b0071c4d8 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:02 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:02 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 1073741824 Sep 11 23:11:02 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:03 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 1073741824" returned: 0 in 0.603s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:03 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 Sep 11 23:11:03 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:03 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:03 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Attempting download of 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 77440bd3-d264-447f-aba8-441b0071c4d8. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:11:03 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79cb0ac-6d73-439c-a298-5eb8b5290518]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_efvkuj90 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:03 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_efvkuj90 Sep 11 23:11:03 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:04 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_efvkuj90" returned: 0 in 0.325s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_efvkuj90 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:04 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_efvkuj90 Sep 11 23:11:04 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:04 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_efvkuj90" returned: 1 in 0.337s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_efvkuj90' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91f8043-9e76-4689-b549-959e13fbd247]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:04 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD Sep 11 23:11:04 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:04 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] 30dc07db-5049-43e5-a274-fa94fe6ac71d was qcow2, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:11:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:04 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 Sep 11 23:11:04 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:06 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8" returned: 0 in 1.596s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_ovebrxwjdevstack@QuobyteHD, size 112.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:11:06 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Converted 112.00 MB image at 70.10 MB/s Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:06 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 1G Sep 11 23:11:06 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:06 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 1G" returned: 0 in 0.358s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Downloaded image 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 77440bd3-d264-447f-aba8-441b0071c4d8 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d for user ad083e7bca1d46bb9158381e20984f3b is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Marking volume 77440bd3-d264-447f-aba8-441b0071c4d8 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Copying metadata from image 30dc07db-5049-43e5-a274-fa94fe6ac71d to 77440bd3-d264-447f-aba8-441b0071c4d8. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Creating volume glance metadata for volume 77440bd3-d264-447f-aba8-441b0071c4d8 backed by image 30dc07db-5049-43e5-a274-fa94fe6ac71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b815cea6-ec1e-4587-bf66-5d269683e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77440bd3-d264-447f-aba8-441b0071c4d8', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf249ebf-a5f2-4a51-b407-844a69bb2b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:06 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Volume volume-77440bd3-d264-447f-aba8-441b0071c4d8 (77440bd3-d264-447f-aba8-441b0071c4d8): created successfully Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf249ebf-a5f2-4a51-b407-844a69bb2b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Flow 'volume_create_manager' (b464f423-0168-41ea-9921-0cdf61aa4b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cea4bcb5-4a2f-44d2-8c7c-7736316cce45 tempest-VolumesExtendTest-744970490 None] Created volume successfully. Sep 11 23:11:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dbfcba8-5c59-4bfb-8698-5195de1ee1a7 tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dbfcba8-5c59-4bfb-8698-5195de1ee1a7 tempest-VolumesExtendTest-744970490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:08 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7b01ac-25a3-4e2d-96d1-3cd938f16e4e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6dbfcba8-5c59-4bfb-8698-5195de1ee1a7 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:08 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 Sep 11 23:11:08 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:08 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6dbfcba8-5c59-4bfb-8698-5195de1ee1a7 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8" returned: 0 in 0.451s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6dbfcba8-5c59-4bfb-8698-5195de1ee1a7 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 2G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6dbfcba8-5c59-4bfb-8698-5195de1ee1a7 tempest-VolumesExtendTest-744970490 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 2G" returned: 0 in 0.095s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6dbfcba8-5c59-4bfb-8698-5195de1ee1a7 tempest-VolumesExtendTest-744970490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.568s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:08 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6dbfcba8-5c59-4bfb-8698-5195de1ee1a7 tempest-VolumesExtendTest-744970490 None] Extend volume completed successfully. Sep 11 23:11:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Acquiring lock "cinder-77440bd3-d264-447f-aba8-441b0071c4d8-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Lock "cinder-77440bd3-d264-447f-aba8-441b0071c4d8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Acquiring lock "cinder-quobyte-77440bd3-d264-447f-aba8-441b0071c4d8" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Lock "cinder-quobyte-77440bd3-d264-447f-aba8-441b0071c4d8" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:09 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9ec77c-515f-4c2d-b152-79a9db6130d4]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:09 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 Sep 11 23:11:09 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:10 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8" returned: 0 in 0.371s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:10 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8 Sep 11 23:11:10 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:10 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-77440bd3-d264-447f-aba8-441b0071c4d8" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Lock "cinder-quobyte-77440bd3-d264-447f-aba8-441b0071c4d8" released by "delete_volume" :: held 0.707s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Created reservations ['edb29b07-04c5-484e-8ca2-8fa4992fe8fc', 'bb5a24b1-dd53-404a-a27c-ca5e6b3d0770', '675fc08f-6e71-4bff-a954-f31cf5269487', 'b0c8d124-a059-452b-ba95-868aa6699dde'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:10 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:10 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:10 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.315s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:10 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:10 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Deleted volume successfully. Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-887b1543-b557-4378-8f0c-73bc3d59e642 tempest-VolumesExtendTest-744970490 None] Lock "cinder-77440bd3-d264-447f-aba8-441b0071c4d8-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:11 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:11 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:11 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.549s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Flow 'volume_create_manager' (159e6b95-0e5e-4e87-90c7-773eea14cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81eb1601-2817-4f2d-b226-77c79aa904f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81eb1601-2817-4f2d-b226-77c79aa904f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-651213662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414a49d2-04e1-460a-8e60-e1b1c17a28bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a5c5e644c4e6e8bc6f9d5855cc596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:12Z,use_quota=True,user_id='ad083e7bca1d46bb9158381e20984f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73286079-0547-44ba-8d51-5317c14dbdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73286079-0547-44ba-8d51-5317c14dbdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3536284d-92b7-4dc5-b470-57bb01424f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3536284d-92b7-4dc5-b470-57bb01424f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414a49d2-04e1-460a-8e60-e1b1c17a28bc', 'volume_name': 'volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb38b04-8715-4fde-908f-d092fb0a276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb38b04-8715-4fde-908f-d092fb0a276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38cd2f8-7da6-49b7-bb64-b69e161ef459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:12 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Volume 414a49d2-04e1-460a-8e60-e1b1c17a28bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc', 'volume_size': 1} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-651213662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414a49d2-04e1-460a-8e60-e1b1c17a28bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0a5c5e644c4e6e8bc6f9d5855cc596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:12Z,use_quota=True,user_id='ad083e7bca1d46bb9158381e20984f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Creating volume 414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:12 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:12 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc 1073741824 Sep 11 23:11:12 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:12 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc 1073741824" returned: 0 in 0.513s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:12 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc Sep 11 23:11:12 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:13 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38cd2f8-7da6-49b7-bb64-b69e161ef459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04491d0-a132-4d53-a5f9-39013333f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Volume volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc (414a49d2-04e1-460a-8e60-e1b1c17a28bc): created successfully Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04491d0-a132-4d53-a5f9-39013333f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Flow 'volume_create_manager' (159e6b95-0e5e-4e87-90c7-773eea14cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:13 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-34ddf792-122a-494c-879c-bfdd37536314 tempest-VolumesExtendTest-744970490 None] Created volume successfully. Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Flow 'volume_create_manager' (c1fd7ef9-d84d-4dd4-bf23-9c9212027678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a53e96-7dee-41c8-a6eb-ee95d965155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a53e96-7dee-41c8-a6eb-ee95d965155a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-905658481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93e682e-075b-4467-b2c5-988cd397ec33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac8e3f15213407fa3da00033dad9719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:14Z,use_quota=True,user_id='ce25c25587c443e3bfa7013bb62276e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3253ce-fab6-4c33-9f16-d59b295b1d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3253ce-fab6-4c33-9f16-d59b295b1d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a28125f-2e92-4bee-962f-6798a542be52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a28125f-2e92-4bee-962f-6798a542be52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93e682e-075b-4467-b2c5-988cd397ec33', 'volume_name': 'volume-a93e682e-075b-4467-b2c5-988cd397ec33', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb69d12d-5f6b-415b-8dcd-37ea02ac68cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb69d12d-5f6b-415b-8dcd-37ea02ac68cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24b0521-c508-4c25-b9b9-5dc5ac60dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Volume a93e682e-075b-4467-b2c5-988cd397ec33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93e682e-075b-4467-b2c5-988cd397ec33', 'volume_size': 1} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-905658481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93e682e-075b-4467-b2c5-988cd397ec33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac8e3f15213407fa3da00033dad9719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:14Z,use_quota=True,user_id='ce25c25587c443e3bfa7013bb62276e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Creating volume a93e682e-075b-4467-b2c5-988cd397ec33 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:13 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:13 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 1073741824 Sep 11 23:11:13 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:14 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 1073741824" returned: 0 in 0.431s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:14 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 Sep 11 23:11:14 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:14 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33" returned: 0 in 0.243s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.476s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24b0521-c508-4c25-b9b9-5dc5ac60dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93e682e-075b-4467-b2c5-988cd397ec33', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e829d1b4-24d0-44a1-a3cc-c6c7ba000521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Creating offline snapshot 435eed42-ac24-45ae-921b-72c469f9a286 of volume 414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:14 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Volume volume-a93e682e-075b-4467-b2c5-988cd397ec33 (a93e682e-075b-4467-b2c5-988cd397ec33): created successfully Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e829d1b4-24d0-44a1-a3cc-c6c7ba000521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Flow 'volume_create_manager' (c1fd7ef9-d84d-4dd4-bf23-9c9212027678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e53732a-1e9b-4d42-8542-e520a7dc7a5c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3c0d1f78-194b-4bd3-b976-f51e82bcbe27 tempest-AttachVolumeNegativeTest-1722998956 None] Created volume successfully. Sep 11 23:11:14 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc Sep 11 23:11:14 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:14 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc" returned: 0 in 0.399s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:15 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 1G Sep 11 23:11:15 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:15 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 1G" returned: 0 in 0.479s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:15 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 Sep 11 23:11:15 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8c9779ea-7257-46d3-9965-c00a4504f556 req-4de4ec4a-4656-4ab9-9811-447cf207215d tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:15 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286" returned: 0 in 0.293s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:15 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 is being set with open permissions: ugo+rw Sep 11 23:11:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:15 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 Sep 11 23:11:15 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:15 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286" returned: 0 in 0.246s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:16 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.info Sep 11 23:11:16 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:16 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.info" returned: 0 in 0.293s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:16 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.info is being set with open permissions: ugo+rw Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:16 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.info Sep 11 23:11:16 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:16 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.info" returned: 0 in 0.250s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8c9779ea-7257-46d3-9965-c00a4504f556 req-4de4ec4a-4656-4ab9-9811-447cf207215d tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.109s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-8c9779ea-7257-46d3-9965-c00a4504f556 req-4de4ec4a-4656-4ab9-9811-447cf207215d tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d9146612-33b2-46fb-9692-19dd8c8c34fa tempest-VolumesExtendTest-744970490 None] Create snapshot completed successfully Sep 11 23:11:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-8c9779ea-7257-46d3-9965-c00a4504f556 req-4de4ec4a-4656-4ab9-9811-447cf207215d tempest-AttachVolumeNegativeTest-1722998956 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-a93e682e-075b-4467-b2c5-988cd397ec33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '724959d7-a3f4-4176-9424-354567b5721b', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:11:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-8c9779ea-7257-46d3-9965-c00a4504f556 req-4de4ec4a-4656-4ab9-9811-447cf207215d tempest-AttachVolumeNegativeTest-1722998956 None] attachment_update completed successfully. Sep 11 23:11:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdef06b2-960c-4c86-858d-0266903ff13f tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdef06b2-960c-4c86-858d-0266903ff13f tempest-VolumesExtendTest-744970490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39142bd-02a8-454f-a0b2-3ab5ba4b3c0e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdef06b2-960c-4c86-858d-0266903ff13f tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:17 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc Sep 11 23:11:17 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:17 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdef06b2-960c-4c86-858d-0266903ff13f tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc" returned: 0 in 0.420s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdef06b2-960c-4c86-858d-0266903ff13f tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 2G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdef06b2-960c-4c86-858d-0266903ff13f tempest-VolumesExtendTest-744970490 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 2G" returned: 0 in 0.131s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdef06b2-960c-4c86-858d-0266903ff13f tempest-VolumesExtendTest-744970490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.600s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cdef06b2-960c-4c86-858d-0266903ff13f tempest-VolumesExtendTest-744970490 None] Extend volume completed successfully. Sep 11 23:11:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-a2d9d1ee-be9c-4c27-a2e3-ed55e4b63ee8 req-8870c112-b1e3-4635-9e01-9d522c01c3b4 tempest-AttachVolumeNegativeTest-1722998956 None] Terminate volume connection completed successfully. Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-a2d9d1ee-be9c-4c27-a2e3-ed55e4b63ee8 req-8870c112-b1e3-4635-9e01-9d522c01c3b4 tempest-AttachVolumeNegativeTest-1722998956 None] Deleting attachment 724959d7-a3f4-4176-9424-354567b5721b. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Acquiring lock "cinder-435eed42-ac24-45ae-921b-72c469f9a286-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Lock "cinder-435eed42-ac24-45ae-921b-72c469f9a286-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Acquiring lock "cinder-quobyte-414a49d2-04e1-460a-8e60-e1b1c17a28bc" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Lock "cinder-quobyte-414a49d2-04e1-460a-8e60-e1b1c17a28bc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Acquiring lock "cinder-quobyte-435eed42-ac24-45ae-921b-72c469f9a286" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Lock "cinder-quobyte-435eed42-ac24-45ae-921b-72c469f9a286" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Deleting offline snapshot 435eed42-ac24-45ae-921b-72c469f9a286 of volume 414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] snapshot_file for this snap is: volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb8ec23-eb42-48a5-890d-2d24b40d330a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:19 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 Sep 11 23:11:19 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:19 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286" returned: 0 in 0.563s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c128da00-d7e6-444c-9649-f02491e3ff8b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:19 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc Sep 11 23:11:19 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:20 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc" returned: 0 in 0.643s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:20 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 Sep 11 23:11:20 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:20 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286" returned: 0 in 0.567s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:20 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286 Sep 11 23:11:20 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:21 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc.435eed42-ac24-45ae-921b-72c469f9a286" returned: 0 in 0.379s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Lock "cinder-quobyte-435eed42-ac24-45ae-921b-72c469f9a286" released by "_delete_snapshot" :: held 2.331s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Lock "cinder-quobyte-414a49d2-04e1-460a-8e60-e1b1c17a28bc" released by "delete_snapshot" :: held 2.367s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:21 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Created reservations ['3e3526f3-5d18-4758-87b2-30aa39cd3f35', 'e0dbbd91-f296-4f9b-ba43-32e75e4c6705', '0fff1448-c0b0-4af8-a6ec-67caa6411b84', 'e18fff06-ae9c-4cc0-8990-e425415a7cdc'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:21 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Delete snapshot completed successfully. Sep 11 23:11:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-20297b16-2e25-47f7-afbb-ba5fb28915d4 tempest-VolumesExtendTest-744970490 None] Lock "cinder-435eed42-ac24-45ae-921b-72c469f9a286-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Acquiring lock "cinder-414a49d2-04e1-460a-8e60-e1b1c17a28bc-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Lock "cinder-414a49d2-04e1-460a-8e60-e1b1c17a28bc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=60,cinder:SELECT=54,cinder:INSERT=18,cinder:DELETE=5 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Acquiring lock "cinder-quobyte-414a49d2-04e1-460a-8e60-e1b1c17a28bc" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Lock "cinder-quobyte-414a49d2-04e1-460a-8e60-e1b1c17a28bc" acquired by "delete_volume" :: waited 0.044s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f85d500-9a54-4748-ad82-b697ee6d890c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:22 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc Sep 11 23:11:22 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:22 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc" returned: 0 in 0.461s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:22 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc Sep 11 23:11:22 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:23 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-414a49d2-04e1-460a-8e60-e1b1c17a28bc" returned: 0 in 0.344s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Lock "cinder-quobyte-414a49d2-04e1-460a-8e60-e1b1c17a28bc" released by "delete_volume" :: held 0.922s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Created reservations ['aa41b28a-886e-4b95-9ad1-d664ece450f0', 'f4e39fcc-0c15-42e9-a4b3-9794bbe301d6', 'df31feda-5ae6-4b66-95ca-08d37b6d3b26', 'a2384ce0-add7-4afc-9918-93ffeae6c712'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:23 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:23 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Flow 'volume_create_manager' (ac249358-c1d0-437d-8546-1cd7f572ec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfd1c72-2c1a-45de-9885-aea190b15c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfd1c72-2c1a-45de-9885-aea190b15c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-162088231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaae42f-84d5-46ea-b020-07cec6b9a573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f913d2c2ef8b49e1b5baacab92e4ef15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:23Z,use_quota=True,user_id='37bb12c121cd471391d9ac7a3aa1c6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae13eabd-c334-4567-9b7f-4a0f01ff5c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae13eabd-c334-4567-9b7f-4a0f01ff5c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b5ece1-eb2e-4580-aee6-56935531bc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b5ece1-eb2e-4580-aee6-56935531bc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eaae42f-84d5-46ea-b020-07cec6b9a573', 'volume_name': 'volume-0eaae42f-84d5-46ea-b020-07cec6b9a573', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d5d946-6f44-400b-b6ed-5d1e99723575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d5d946-6f44-400b-b6ed-5d1e99723575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2720df-2121-4d52-93a0-6d8ba85bb86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:23 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Volume 0eaae42f-84d5-46ea-b020-07cec6b9a573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eaae42f-84d5-46ea-b020-07cec6b9a573', 'volume_size': 1} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-162088231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaae42f-84d5-46ea-b020-07cec6b9a573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f913d2c2ef8b49e1b5baacab92e4ef15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:23Z,use_quota=True,user_id='37bb12c121cd471391d9ac7a3aa1c6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Creating volume 0eaae42f-84d5-46ea-b020-07cec6b9a573 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:23 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:23 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 1073741824 Sep 11 23:11:23 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "cinder-a93e682e-075b-4467-b2c5-988cd397ec33-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-a93e682e-075b-4467-b2c5-988cd397ec33-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "cinder-quobyte-a93e682e-075b-4467-b2c5-988cd397ec33" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-quobyte-a93e682e-075b-4467-b2c5-988cd397ec33" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2dc867-b649-4f2d-946d-441bdb73dbd6]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:23 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.361s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:23 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Deleted volume successfully. Sep 11 23:11:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6f204562-0b92-4a30-8a1b-fd5c310057b7 tempest-VolumesExtendTest-744970490 None] Lock "cinder-414a49d2-04e1-460a-8e60-e1b1c17a28bc-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:23 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 Sep 11 23:11:23 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:24 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 1073741824" returned: 0 in 0.467s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:24 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 Sep 11 23:11:24 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:24 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33" returned: 0 in 0.421s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:24 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33 Sep 11 23:11:24 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:24 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573" returned: 0 in 0.300s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d2720df-2121-4d52-93a0-6d8ba85bb86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eaae42f-84d5-46ea-b020-07cec6b9a573', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea3c968-af24-4a86-925d-2ad9ec3ff4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:24 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Volume volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 (0eaae42f-84d5-46ea-b020-07cec6b9a573): created successfully Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea3c968-af24-4a86-925d-2ad9ec3ff4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Flow 'volume_create_manager' (ac249358-c1d0-437d-8546-1cd7f572ec1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6fdac895-1d9e-46a9-81f2-49a5612eaecf tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Created volume successfully. Sep 11 23:11:24 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a93e682e-075b-4467-b2c5-988cd397ec33" returned: 0 in 0.360s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-quobyte-a93e682e-075b-4467-b2c5-988cd397ec33" released by "delete_volume" :: held 0.834s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Created reservations ['67312ed2-034b-414e-b84d-ab4d3d0fe90e', '0f4d51e9-0a6e-4614-bc1f-740c92cf6b0b', '044a5d07-7e13-4f55-bb77-01e6c48f480c', '366ec6c2-fa1d-4e71-9575-ed324f2209a3'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:24 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:24 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "cinder-e92103d0-88e8-413d-8685-ea34fe36cdb3-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:25 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.379s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-e92103d0-88e8-413d-8685-ea34fe36cdb3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Deleted volume successfully. Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-456b71fb-b747-4a2a-a1e7-32e86c0e2e41 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-a93e682e-075b-4467-b2c5-988cd397ec33-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "cinder-quobyte-e92103d0-88e8-413d-8685-ea34fe36cdb3" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-quobyte-e92103d0-88e8-413d-8685-ea34fe36cdb3" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9abf8d-6074-460f-803e-3d8777bb384b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:25 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 Sep 11 23:11:25 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:25 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3" returned: 0 in 0.544s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:25 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3 Sep 11 23:11:25 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:26 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e92103d0-88e8-413d-8685-ea34fe36cdb3" returned: 0 in 0.544s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-quobyte-e92103d0-88e8-413d-8685-ea34fe36cdb3" released by "delete_volume" :: held 1.147s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Created reservations ['ede68883-b26d-4350-992c-01874c7a2070', '6d2f437c-e844-40f8-b973-f8ccf946eb72', '4daca66e-c778-400f-883d-716f9d442d2f', '9905c379-0999-4d1c-8b7a-97f537ff19cd'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:26 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:26 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-81dcc655-b5b1-4172-ad08-195554f4fc2b req-38d1ad24-d8e1-448e-ab1b-81daec9562ee tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-81dcc655-b5b1-4172-ad08-195554f4fc2b req-38d1ad24-d8e1-448e-ab1b-81daec9562ee tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-81dcc655-b5b1-4172-ad08-195554f4fc2b req-38d1ad24-d8e1-448e-ab1b-81daec9562ee tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-81dcc655-b5b1-4172-ad08-195554f4fc2b req-38d1ad24-d8e1-448e-ab1b-81daec9562ee tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-0eaae42f-84d5-46ea-b020-07cec6b9a573', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec92ea17-9cda-48f4-b7c9-45d4b0bfe5a7', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:11:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-81dcc655-b5b1-4172-ad08-195554f4fc2b req-38d1ad24-d8e1-448e-ab1b-81daec9562ee tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] attachment_update completed successfully. Sep 11 23:11:26 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.364s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Deleted volume successfully. Sep 11 23:11:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5173d06d-6c08-4993-bbea-fb2b91118abe tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-e92103d0-88e8-413d-8685-ea34fe36cdb3-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "cinder-cd46f807-e33b-49ed-9f56-d59b16767493-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-cd46f807-e33b-49ed-9f56-d59b16767493-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "cinder-quobyte-cd46f807-e33b-49ed-9f56-d59b16767493" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-quobyte-cd46f807-e33b-49ed-9f56-d59b16767493" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2910b3a0-b3ed-4732-932b-707ffc1d586e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:28 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 Sep 11 23:11:28 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:28 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493" returned: 0 in 0.548s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:28 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493 Sep 11 23:11:28 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd46f807-e33b-49ed-9f56-d59b16767493" returned: 0 in 0.546s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-quobyte-cd46f807-e33b-49ed-9f56-d59b16767493" released by "delete_volume" :: held 1.157s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Created reservations ['904f261c-fb48-4548-938d-48f4482550f0', '41604a6e-8029-47ee-99ef-43373f01066a', '9e48b9ce-739f-4f96-add5-d41ce3098d35', '4c48d863-1d3c-4485-b37e-920c29ce0cbb'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:29 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:29 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-07aa177b-fabc-4935-861d-6b13c727193e req-eb50b32b-d059-4a59-ad5a-b3d29c52eefa tempest-TestMinimumBasicScenario-1351515901 None] Terminate volume connection completed successfully. Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-07aa177b-fabc-4935-861d-6b13c727193e req-eb50b32b-d059-4a59-ad5a-b3d29c52eefa tempest-TestMinimumBasicScenario-1351515901 None] Deleting attachment bc17fbce-b104-40dc-8dc9-8ac2c2f862db. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:11:29 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.352s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Deleted volume successfully. Sep 11 23:11:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fb81e4ea-7053-4b3b-aeff-f46d831317d6 tempest-AttachVolumeNegativeTest-1722998956 None] Lock "cinder-cd46f807-e33b-49ed-9f56-d59b16767493-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Acquiring lock "cinder-39a57886-1336-49f5-94bc-ea661c7b0454-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Lock "cinder-39a57886-1336-49f5-94bc-ea661c7b0454-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Acquiring lock "cinder-quobyte-39a57886-1336-49f5-94bc-ea661c7b0454" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Lock "cinder-quobyte-39a57886-1336-49f5-94bc-ea661c7b0454" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b24c2c2-5f4b-44f6-af81-c7fa43987133]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:30 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 Sep 11 23:11:30 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (db8a4c15-440e-4465-83c3-552530fb2729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b5d1dd-d3a6-4683-b71d-310d29061325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b5d1dd-d3a6-4683-b71d-310d29061325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1383175228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e222bca5-6c38-4a57-bf5f-462008a04b8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:31Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876e4d91-0793-4753-901a-32a635ed58a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876e4d91-0793-4753-901a-32a635ed58a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8256429-f764-46db-a7bf-fe018ae0d405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8256429-f764-46db-a7bf-fe018ae0d405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e222bca5-6c38-4a57-bf5f-462008a04b8b', 'volume_name': 'volume-e222bca5-6c38-4a57-bf5f-462008a04b8b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d77e1b-5096-409b-8569-68456e466558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d77e1b-5096-409b-8569-68456e466558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62e94de-e6da-477e-984d-5480ab416752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:30 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Volume e222bca5-6c38-4a57-bf5f-462008a04b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e222bca5-6c38-4a57-bf5f-462008a04b8b', 'volume_size': 1} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1383175228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e222bca5-6c38-4a57-bf5f-462008a04b8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:31Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Creating volume e222bca5-6c38-4a57-bf5f-462008a04b8b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:30 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:30 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b 1073741824 Sep 11 23:11:30 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:31 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454" returned: 0 in 0.559s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:31 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-9575daeb-35a5-4bda-b5fd-d644510cf9b9 req-70672837-0393-4487-854f-af9f8fd9abb0 tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Terminate volume connection completed successfully. Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-9575daeb-35a5-4bda-b5fd-d644510cf9b9 req-70672837-0393-4487-854f-af9f8fd9abb0 tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Deleting attachment ec92ea17-9cda-48f4-b7c9-45d4b0bfe5a7. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:11:31 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454 Sep 11 23:11:31 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:31 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-39a57886-1336-49f5-94bc-ea661c7b0454" returned: 0 in 0.406s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Lock "cinder-quobyte-39a57886-1336-49f5-94bc-ea661c7b0454" released by "delete_volume" :: held 1.052s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:31 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b 1073741824" returned: 0 in 0.688s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Created reservations ['fe276675-2a1f-46de-a7b1-da7a40d28a87', 'f02e09ad-0188-4d72-b3f9-19bffdda4f2e', '96e3373a-00b5-48fe-acd8-3721500b9fa4', 'ce84b057-fea6-443d-a7b4-8b4a7ceb7c68'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:31 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b Sep 11 23:11:31 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:31 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:31 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Acquiring lock "cinder-0eaae42f-84d5-46ea-b020-07cec6b9a573-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:31 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b" returned: 0 in 0.387s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "cinder-0eaae42f-84d5-46ea-b020-07cec6b9a573-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62e94de-e6da-477e-984d-5480ab416752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e222bca5-6c38-4a57-bf5f-462008a04b8b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8113aeb7-0b4e-454e-a39a-b318f5de75ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:32 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Volume volume-e222bca5-6c38-4a57-bf5f-462008a04b8b (e222bca5-6c38-4a57-bf5f-462008a04b8b): created successfully Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8113aeb7-0b4e-454e-a39a-b318f5de75ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (db8a4c15-440e-4465-83c3-552530fb2729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:32 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.347s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:32 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a7c2f1a1-7a5b-40ca-93b3-2cdc4ea0360d tempest-VolumesGetTest-473659801 None] Created volume successfully. Sep 11 23:11:32 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Deleted volume successfully. Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Acquiring lock "cinder-quobyte-0eaae42f-84d5-46ea-b020-07cec6b9a573" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "cinder-quobyte-0eaae42f-84d5-46ea-b020-07cec6b9a573" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3fa4590f-cd48-41cd-95d4-4854ce653220 tempest-TestMinimumBasicScenario-1351515901 None] Lock "cinder-39a57886-1336-49f5-94bc-ea661c7b0454-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5a3969-59eb-4d68-ac2e-e531bc732dc3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:32 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 Sep 11 23:11:32 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:32 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:32 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573 Sep 11 23:11:32 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:32 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0eaae42f-84d5-46ea-b020-07cec6b9a573" returned: 0 in 0.350s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "cinder-quobyte-0eaae42f-84d5-46ea-b020-07cec6b9a573" released by "delete_volume" :: held 0.846s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Created reservations ['79a36193-aeb8-4ac2-bc0b-d0a28e090e29', 'd6bf3dd4-9804-40eb-9b72-f3fcba79bb09', '719ada9c-11e5-40a7-9f3b-5b982f8b5486', 'b5432010-f1e4-4b24-8cce-a28cf12439c1'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:33 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:33 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:33 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.536s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Deleted volume successfully. Sep 11 23:11:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-085bc123-4f97-446f-9e8e-3dd6bf413f6f tempest-TestServerVolumeAttachScenarioOldVersion-410584382 None] Lock "cinder-0eaae42f-84d5-46ea-b020-07cec6b9a573-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (29123a95-b7db-4d35-a293-7c84d3006b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cd0ca3-4c4e-41d9-8e9b-99fcf5e1b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cd0ca3-4c4e-41d9-8e9b-99fcf5e1b27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1566649669',display_name='tempest-VolumesGetTest-Volume-193624737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9d876b-81d9-4b0a-8895-b2218bc92f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:34Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddcec2b4-97c3-4dad-926a-a5fdc501c756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddcec2b4-97c3-4dad-926a-a5fdc501c756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf19f4c-7995-435f-94de-899a7fc8392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf19f4c-7995-435f-94de-899a7fc8392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec9d876b-81d9-4b0a-8895-b2218bc92f78', 'volume_name': 'volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57f8b21-55c4-489f-acae-ff64d8323529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57f8b21-55c4-489f-acae-ff64d8323529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b05cc53-b0a3-478e-aae7-d20cf8fedb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Volume ec9d876b-81d9-4b0a-8895-b2218bc92f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78', 'volume_size': 1} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1566649669',display_name='tempest-VolumesGetTest-Volume-193624737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9d876b-81d9-4b0a-8895-b2218bc92f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:34Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Creating volume ec9d876b-81d9-4b0a-8895-b2218bc92f78 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:34 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:34 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 1073741824 Sep 11 23:11:34 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:34 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 1073741824" returned: 0 in 0.677s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:35 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 Sep 11 23:11:35 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:35 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78" returned: 0 in 0.495s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b05cc53-b0a3-478e-aae7-d20cf8fedb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d25b78-e6db-4e76-9b63-88689b8eeb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:35 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Volume volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 (ec9d876b-81d9-4b0a-8895-b2218bc92f78): created successfully Sep 11 23:11:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d25b78-e6db-4e76-9b63-88689b8eeb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (29123a95-b7db-4d35-a293-7c84d3006b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:35 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4811d4ae-b74b-47a4-a40b-35a19cf49141 tempest-VolumesGetTest-473659801 None] Created volume successfully. Sep 11 23:11:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-ec9d876b-81d9-4b0a-8895-b2218bc92f78-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Lock "cinder-ec9d876b-81d9-4b0a-8895-b2218bc92f78-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-ec9d876b-81d9-4b0a-8895-b2218bc92f78" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-ec9d876b-81d9-4b0a-8895-b2218bc92f78" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:36 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c156f5d-52cf-442d-aede-69f27125a71e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:36 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 Sep 11 23:11:36 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:37 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78" returned: 0 in 0.531s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:37 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78 Sep 11 23:11:37 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:37 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ec9d876b-81d9-4b0a-8895-b2218bc92f78" returned: 0 in 0.519s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-ec9d876b-81d9-4b0a-8895-b2218bc92f78" released by "delete_volume" :: held 1.117s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Created reservations ['3f5962e0-ef2c-4ce3-b6d5-ad72c473c3a1', '7186955f-9640-4883-abda-0a06517b6bd9', '246bfeaa-e09e-414d-96cd-51b74d380248', '9fbf4fc1-2988-4264-bdba-aa3d7fa05933'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:37 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:37 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:38 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.319s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:38 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Deleted volume successfully. Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-55f0cfb1-3a0a-4c48-835b-aeb563e1cb9a tempest-VolumesGetTest-473659801 None] Lock "cinder-ec9d876b-81d9-4b0a-8895-b2218bc92f78-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-e222bca5-6c38-4a57-bf5f-462008a04b8b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Lock "cinder-e222bca5-6c38-4a57-bf5f-462008a04b8b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-e222bca5-6c38-4a57-bf5f-462008a04b8b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-e222bca5-6c38-4a57-bf5f-462008a04b8b" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c75976-aea4-4cb8-b18a-8c6c1f4021cf]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:39 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b Sep 11 23:11:39 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:39 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b" returned: 0 in 0.558s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:39 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b Sep 11 23:11:39 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:39 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e222bca5-6c38-4a57-bf5f-462008a04b8b" returned: 0 in 0.358s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-e222bca5-6c38-4a57-bf5f-462008a04b8b" released by "delete_volume" :: held 0.994s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:39 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Created reservations ['2e1a92a0-885a-4ced-8e80-3f82ef1a5cd1', '2167d514-8cbd-40a0-a628-35cca0e60686', 'e28592b3-9b43-41c4-988f-7086497b4115', '7f609a65-2586-4993-85dd-fd38494abc51'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:40 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:11:40 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:40 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.382s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:11:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Deleted volume successfully. Sep 11 23:11:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-724394a3-0c7f-4e0e-ac6f-e5b753c66161 tempest-VolumesGetTest-473659801 None] Lock "cinder-e222bca5-6c38-4a57-bf5f-462008a04b8b-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (d9b9fac2-33e8-47b2-8260-afe6d2fe3ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd8e97a-3f58-4585-90c2-8d543ea8da3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd8e97a-3f58-4585-90c2-8d543ea8da3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1246902643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e781d1c-2ecc-4a29-bb05-44bf01ad4aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:42Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a6cdca-1b05-40d9-a8db-64fe9b566879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a6cdca-1b05-40d9-a8db-64fe9b566879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1517e18b-c978-46cb-9a2c-548c54f07d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1517e18b-c978-46cb-9a2c-548c54f07d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e781d1c-2ecc-4a29-bb05-44bf01ad4aec', 'volume_name': 'volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c73c6b-fdb8-469c-b68d-ac12342c8002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c73c6b-fdb8-469c-b68d-ac12342c8002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8ad777-96d1-40a2-9e01-2f709e1fd28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Volume 9e781d1c-2ecc-4a29-bb05-44bf01ad4aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec', 'volume_size': 1} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1246902643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e781d1c-2ecc-4a29-bb05-44bf01ad4aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:42Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Creating volume 9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:41 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:41 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec 1073741824 Sep 11 23:11:41 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:42 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec 1073741824" returned: 0 in 0.829s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Flow 'volume_create_manager' (2eea3af5-3e31-405c-b2a8-163fb2b13433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd30087-a426-4fb0-b29f-3607100b3136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd30087-a426-4fb0-b29f-3607100b3136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-750348265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d6c55d-0835-4315-bdbf-0e071614ea22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93266ccb1161417b8cd36b4b61e1da75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:43Z,use_quota=True,user_id='5a1941150a074f8fa9e9d4d42d5d0bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284dfd85-4df7-438c-bcf5-c2d22a9bab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:42 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec Sep 11 23:11:42 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284dfd85-4df7-438c-bcf5-c2d22a9bab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7d8abd-8d5a-40ab-a3be-24dd1d0744c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7d8abd-8d5a-40ab-a3be-24dd1d0744c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d6c55d-0835-4315-bdbf-0e071614ea22', 'volume_name': 'volume-37d6c55d-0835-4315-bdbf-0e071614ea22', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c52074-20fc-46ce-a93f-7103de7795ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c52074-20fc-46ce-a93f-7103de7795ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c158429f-65de-4521-95e3-4fb8ea93480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Volume 37d6c55d-0835-4315-bdbf-0e071614ea22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d6c55d-0835-4315-bdbf-0e071614ea22', 'volume_size': 1} Sep 11 23:11:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:43 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" returned: 0 in 0.317s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-750348265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d6c55d-0835-4315-bdbf-0e071614ea22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93266ccb1161417b8cd36b4b61e1da75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:43Z,use_quota=True,user_id='5a1941150a074f8fa9e9d4d42d5d0bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Creating volume 37d6c55d-0835-4315-bdbf-0e071614ea22 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:43 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8ad777-96d1-40a2-9e01-2f709e1fd28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:43 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 1073741824 Sep 11 23:11:43 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd6565c-683c-46f2-98d6-3f7a5e29c330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Volume volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec (9e781d1c-2ecc-4a29-bb05-44bf01ad4aec): created successfully Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd6565c-683c-46f2-98d6-3f7a5e29c330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (d9b9fac2-33e8-47b2-8260-afe6d2fe3ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:43 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3b9ff849-6dec-434a-8bfa-5e651da70146 tempest-VolumesGetTest-473659801 None] Created volume successfully. Sep 11 23:11:43 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 1073741824" returned: 0 in 0.736s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=123,cinder:DELETE=10,cinder:SELECT=108,cinder:INSERT=34 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:11:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:43 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 Sep 11 23:11:43 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:44 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22" returned: 0 in 0.299s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c158429f-65de-4521-95e3-4fb8ea93480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d6c55d-0835-4315-bdbf-0e071614ea22', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8903c97-599f-441b-acef-068b1f4b7c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Volume volume-37d6c55d-0835-4315-bdbf-0e071614ea22 (37d6c55d-0835-4315-bdbf-0e071614ea22): created successfully Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8903c97-599f-441b-acef-068b1f4b7c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Flow 'volume_create_manager' (2eea3af5-3e31-405c-b2a8-163fb2b13433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-82c06a0c-3505-4f71-9719-5177e87b7f89 req-a875ec80-b55c-4709-a868-78c02a7138b7 tempest-VolumesSnapshotsTestJSON-1161087993 None] Created volume successfully. Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (bc860add-9efc-4fd6-84fb-6967c5b53e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763c10a9-e20a-4126-be54-3ac2b714ebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763c10a9-e20a-4126-be54-3ac2b714ebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-247327806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbae86d4-b1e5-46b2-967e-d283f79d32c5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9e781d1c-2ecc-4a29-bb05-44bf01ad4aec,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:44Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab440889-78ef-4cd0-865f-0e43de63b764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab440889-78ef-4cd0-865f-0e43de63b764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9488f6fe-c9fa-47db-897e-4318719fdb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9488f6fe-c9fa-47db-897e-4318719fdb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cbae86d4-b1e5-46b2-967e-d283f79d32c5', 'volume_name': 'volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5', 'volume_size': 1, 'source_volid': '9e781d1c-2ecc-4a29-bb05-44bf01ad4aec', 'source_volstatus': 'available'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e00424-c7df-405f-b0a1-a751f2021684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e00424-c7df-405f-b0a1-a751f2021684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5debf60-4cdb-4d57-b18f-cb83a862137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Volume cbae86d4-b1e5-46b2-967e-d283f79d32c5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5', 'volume_size': 1, 'source_volid': '9e781d1c-2ecc-4a29-bb05-44bf01ad4aec', 'source_volstatus': 'available'} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:44 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Cloning volume 9e781d1c-2ecc-4a29-bb05-44bf01ad4aec to volume cbae86d4-b1e5-46b2-967e-d283f79d32c5 Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Creating offline snapshot 5cc64365-fe46-4780-9b6c-d0dae4062429 of volume 9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fae498-39d8-46ce-8e61-9993888cd4f4]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:44 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec Sep 11 23:11:44 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:45 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" returned: 0 in 0.520s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:45 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 1G Sep 11 23:11:45 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:45 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 1G" returned: 0 in 0.631s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:45 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 Sep 11 23:11:45 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:46 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429" returned: 0 in 0.416s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:46 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 is being set with open permissions: ugo+rw Sep 11 23:11:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:46 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 Sep 11 23:11:46 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:46 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429" returned: 0 in 0.326s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:46 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.info Sep 11 23:11:46 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:46 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.info" returned: 0 in 0.358s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:46 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.info is being set with open permissions: ugo+rw Sep 11 23:11:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:46 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.info Sep 11 23:11:46 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:47 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.info" returned: 0 in 0.287s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-cbae86d4-b1e5-46b2-967e-d283f79d32c5" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-cbae86d4-b1e5-46b2-967e-d283f79d32c5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] snapshot: 5cc64365-fe46-4780-9b6c-d0dae4062429, volume: cbae86d4-b1e5-46b2-967e-d283f79d32c5, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9559ebf-afdd-4c71-9701-23ebeb2f9883]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:47 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 Sep 11 23:11:47 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:47 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429" returned: 0 in 0.469s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[522cadbc-2c42-497a-8a09-a5c1bc4c0388]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:47 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec Sep 11 23:11:47 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:48 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" returned: 0 in 0.479s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:11:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:11:48 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:11:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:48 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 Sep 11 23:11:48 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:54 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5" returned: 0 in 5.986s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:11:54 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Converted 1024.00 MB image at 171.00 MB/s Sep 11 23:11:54 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 is being set with open permissions: ugo+rw Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:54 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 Sep 11 23:11:54 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:54 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5" returned: 0 in 0.315s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-cbae86d4-b1e5-46b2-967e-d283f79d32c5" released by "_copy_volume_from_snapshot" :: held 7.335s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-5cc64365-fe46-4780-9b6c-d0dae4062429" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-5cc64365-fe46-4780-9b6c-d0dae4062429" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Deleting offline snapshot 5cc64365-fe46-4780-9b6c-d0dae4062429 of volume 9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] snapshot_file for this snap is: volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f3a744-9fe4-4167-9cd6-8428804e7d6f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:54 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 Sep 11 23:11:54 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:55 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429" returned: 0 in 0.429s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:11:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d176b3ba-9c1e-443b-b0d4-04181969c86b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:55 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec Sep 11 23:11:55 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:55 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" returned: 0 in 0.709s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:55 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 Sep 11 23:11:55 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:56 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429" returned: 0 in 0.522s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:56 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429 Sep 11 23:11:56 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5,cinder:INSERT=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:11:56 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec.5cc64365-fe46-4780-9b6c-d0dae4062429" returned: 0 in 0.348s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-5cc64365-fe46-4780-9b6c-d0dae4062429" released by "_delete_snapshot" :: held 2.155s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.265s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.479s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Creating offline snapshot 07536230-f53b-46ec-8f60-7446f78724d9 of volume 37d6c55d-0835-4315-bdbf-0e071614ea22 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5debf60-4cdb-4d57-b18f-cb83a862137c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5', 'volume_size': 1, 'source_volid': '9e781d1c-2ecc-4a29-bb05-44bf01ad4aec', 'source_volstatus': 'available'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab73568e-f781-4010-8669-d35e4dafa8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f7eee0-bb93-4d82-ab80-16fc493edf3f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:56 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Volume volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 (cbae86d4-b1e5-46b2-967e-d283f79d32c5): created successfully Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab73568e-f781-4010-8669-d35e4dafa8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (bc860add-9efc-4fd6-84fb-6967c5b53e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:57 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-dc185112-c890-40db-913d-5772a4288223 tempest-VolumesGetTest-473659801 None] Created volume successfully. Sep 11 23:11:57 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 Sep 11 23:11:57 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:57 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22" returned: 0 in 0.472s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:57 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 1G Sep 11 23:11:57 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:58 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 1G" returned: 0 in 0.663s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d6c55d-0835-4315-bdbf-0e071614ea22 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:58 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d6c55d-0835-4315-bdbf-0e071614ea22 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 Sep 11 23:11:58 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:58 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d6c55d-0835-4315-bdbf-0e071614ea22 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9" returned: 0 in 0.333s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:58 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 is being set with open permissions: ugo+rw Sep 11 23:11:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:58 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 Sep 11 23:11:58 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:58 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9" returned: 0 in 0.413s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:58 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.info Sep 11 23:11:58 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (c79cca3f-7409-466a-8174-d6cbe9d898b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d695c4-b878-4b0e-884b-27f005857dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d695c4-b878-4b0e-884b-27f005857dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-684814577',display_name='tempest-VolumesGetTest-Volume-1295851792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4601a3-62c9-4d68-a1b4-19127616baca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:59Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc95fb64-4105-4b75-a7ed-bb29dcfb9e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc95fb64-4105-4b75-a7ed-bb29dcfb9e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1f3060-19b9-4144-8a48-4f1eac0012c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1f3060-19b9-4144-8a48-4f1eac0012c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4601a3-62c9-4d68-a1b4-19127616baca', 'volume_name': 'volume-dc4601a3-62c9-4d68-a1b4-19127616baca', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bef1733-ee6a-43ba-8975-2abf515224aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bef1733-ee6a-43ba-8975-2abf515224aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64397990-024c-4af4-b70a-abaa89778e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Volume dc4601a3-62c9-4d68-a1b4-19127616baca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4601a3-62c9-4d68-a1b4-19127616baca', 'volume_size': 1} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:59 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (e15d6455-e17f-44f2-afc8-e09137aed28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc72035-b0cc-4930-ab4f-1995a45591eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.info" returned: 0 in 0.392s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:59 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.info is being set with open permissions: ugo+rw Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc72035-b0cc-4930-ab4f-1995a45591eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561503236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a010e155-4acc-47e9-acc9-1b2885f79400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:59Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:59 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.info Sep 11 23:11:59 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8ea94e-7846-4933-a196-2bdfa8b5218f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8ea94e-7846-4933-a196-2bdfa8b5218f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cead5fc5-fbb0-41a1-9df1-4438926b8ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cead5fc5-fbb0-41a1-9df1-4438926b8ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a010e155-4acc-47e9-acc9-1b2885f79400', 'volume_name': 'volume-a010e155-4acc-47e9-acc9-1b2885f79400', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331a7044-9357-482e-871e-29ff635a0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331a7044-9357-482e-871e-29ff635a0267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811e6686-4005-4201-ab04-c20e81d463e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:11:59 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume a010e155-4acc-47e9-acc9-1b2885f79400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a010e155-4acc-47e9-acc9-1b2885f79400', 'volume_size': 1} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:59 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.info" returned: 0 in 0.267s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-684814577',display_name='tempest-VolumesGetTest-Volume-1295851792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4601a3-62c9-4d68-a1b4-19127616baca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:59Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Creating volume dc4601a3-62c9-4d68-a1b4-19127616baca {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:11:59 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:11:59 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca 1073741824 Sep 11 23:11:59 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:11:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-a7bcf05a-13ea-4da0-96dd-3e4f2bc58375 req-c2cd0db1-fb1c-4f70-b07f-5c79aaa58e8c tempest-VolumesSnapshotsTestJSON-1161087993 None] Create snapshot completed successfully Sep 11 23:11:59 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 11 23:11:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca 1073741824" returned: 0 in 0.433s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:00 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca Sep 11 23:12:00 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "cinder-07536230-f53b-46ec-8f60-7446f78724d9-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-07536230-f53b-46ec-8f60-7446f78724d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "cinder-quobyte-37d6c55d-0835-4315-bdbf-0e071614ea22" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-quobyte-37d6c55d-0835-4315-bdbf-0e071614ea22" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "cinder-quobyte-07536230-f53b-46ec-8f60-7446f78724d9" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-quobyte-07536230-f53b-46ec-8f60-7446f78724d9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Deleting offline snapshot 07536230-f53b-46ec-8f60-7446f78724d9 of volume 37d6c55d-0835-4315-bdbf-0e071614ea22 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] snapshot_file for this snap is: volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbdc46b-fa69-4ff9-9f07-3e86fa1d5123]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:00 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca" returned: 0 in 0.306s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561503236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a010e155-4acc-47e9-acc9-1b2885f79400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:59Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Creating volume a010e155-4acc-47e9-acc9-1b2885f79400 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:00 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64397990-024c-4af4-b70a-abaa89778e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4601a3-62c9-4d68-a1b4-19127616baca', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c8a417-a90e-4302-aba6-f8fda6b7cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:00 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 1073741824 Sep 11 23:12:00 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:00 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Volume volume-dc4601a3-62c9-4d68-a1b4-19127616baca (dc4601a3-62c9-4d68-a1b4-19127616baca): created successfully Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c8a417-a90e-4302-aba6-f8fda6b7cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (c79cca3f-7409-466a-8174-d6cbe9d898b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:00 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 Sep 11 23:12:00 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8d4269cc-53db-4849-8c11-51372967f45a tempest-VolumesGetTest-473659801 None] Created volume successfully. Sep 11 23:12:00 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9" returned: 0 in 0.509s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d6c55d-0835-4315-bdbf-0e071614ea22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f716ab93-3402-436f-9cd5-7391e0fefbf3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:00 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 1073741824" returned: 0 in 0.559s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:00 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 Sep 11 23:12:00 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:00 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 Sep 11 23:12:00 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-dc4601a3-62c9-4d68-a1b4-19127616baca-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Lock "cinder-dc4601a3-62c9-4d68-a1b4-19127616baca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-dc4601a3-62c9-4d68-a1b4-19127616baca" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-dc4601a3-62c9-4d68-a1b4-19127616baca" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[179f37e4-6070-4790-a0a5-7dd0f6f2e63d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:01 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22" returned: 0 in 0.482s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:01 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400" returned: 0 in 0.380s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:01 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 Sep 11 23:12:01 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811e6686-4005-4201-ab04-c20e81d463e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a010e155-4acc-47e9-acc9-1b2885f79400', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7a7e97-9ee5-4918-8962-f731d90e3716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:01 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume volume-a010e155-4acc-47e9-acc9-1b2885f79400 (a010e155-4acc-47e9-acc9-1b2885f79400): created successfully Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7a7e97-9ee5-4918-8962-f731d90e3716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (e15d6455-e17f-44f2-afc8-e09137aed28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7c5e3a76-463a-4350-8eeb-9757401c9a11 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created volume successfully. Sep 11 23:12:01 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca Sep 11 23:12:01 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:01 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca" returned: 0 in 0.372s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:01 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca Sep 11 23:12:01 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:01 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9" returned: 0 in 0.392s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:01 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9 Sep 11 23:12:01 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:01 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-dc4601a3-62c9-4d68-a1b4-19127616baca" returned: 0 in 0.284s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:01 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22.07536230-f53b-46ec-8f60-7446f78724d9" returned: 0 in 0.259s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-dc4601a3-62c9-4d68-a1b4-19127616baca" released by "delete_volume" :: held 0.726s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-quobyte-07536230-f53b-46ec-8f60-7446f78724d9" released by "_delete_snapshot" :: held 1.779s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-quobyte-37d6c55d-0835-4315-bdbf-0e071614ea22" released by "delete_snapshot" :: held 1.819s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Created reservations ['63a22cfb-1110-4201-aecb-5eb2ec839e05', 'a284a2f2-dd16-4314-b949-903893981b56', '4e8e437a-59bd-4ca0-9301-a57bcc6af885', '411d0a71-8a29-43bb-9ded-4a511d41c24d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.quota [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Created reservations ['51f57e66-0edf-4a7c-bfd5-ab300d3e98a3', 'eb5f762f-2b71-4767-b78f-cc45323b9afc', 'c019a746-42c7-40c4-87fd-91efa4463aeb', 'da7fa5aa-ad68-450b-b64f-6a4dc040536d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:02 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:02 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Delete snapshot completed successfully. Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-4c2dc5b1-3e68-4eac-abda-e276cb09b4f7 req-8ea5ede7-9ff6-40b8-8c11-4f83a17009fe tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-07536230-f53b-46ec-8f60-7446f78724d9-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-cbae86d4-b1e5-46b2-967e-d283f79d32c5-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Lock "cinder-cbae86d4-b1e5-46b2-967e-d283f79d32c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-cbae86d4-b1e5-46b2-967e-d283f79d32c5" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-cbae86d4-b1e5-46b2-967e-d283f79d32c5" acquired by "delete_volume" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "cinder-37d6c55d-0835-4315-bdbf-0e071614ea22-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-37d6c55d-0835-4315-bdbf-0e071614ea22-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d776bb1-3c2d-4f31-ba64-0197a181faf3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Creating offline snapshot db8af5e8-2df0-46a6-ba15-d299bae4366d of volume a010e155-4acc-47e9-acc9-1b2885f79400 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "cinder-quobyte-37d6c55d-0835-4315-bdbf-0e071614ea22" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afa4247-019e-45b0-8d08-fdb3eaf615e1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-quobyte-37d6c55d-0835-4315-bdbf-0e071614ea22" acquired by "delete_volume" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:02 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.623s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:02 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 Sep 11 23:12:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Deleted volume successfully. Sep 11 23:12:02 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb98e7b-7573-4169-a8e7-401a290e29dd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60ee3548-9041-4cee-997b-fb88eaa7e0a9 tempest-VolumesGetTest-473659801 None] Lock "cinder-dc4601a3-62c9-4d68-a1b4-19127616baca-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:02 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 Sep 11 23:12:02 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:02 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 Sep 11 23:12:02 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:03 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5" returned: 0 in 0.589s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:03 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5 Sep 11 23:12:03 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:03 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400" returned: 0 in 0.659s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:03 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22" returned: 0 in 0.602s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:03 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d 1G Sep 11 23:12:03 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:03 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22 Sep 11 23:12:03 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:03 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cbae86d4-b1e5-46b2-967e-d283f79d32c5" returned: 0 in 0.558s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-cbae86d4-b1e5-46b2-967e-d283f79d32c5" released by "delete_volume" :: held 1.250s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:03 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-37d6c55d-0835-4315-bdbf-0e071614ea22" returned: 0 in 0.398s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-quobyte-37d6c55d-0835-4315-bdbf-0e071614ea22" released by "delete_volume" :: held 1.096s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Created reservations ['2e5fe6ed-1d98-4fa2-a644-3d7110853cf8', '222ecd49-2439-42dc-ad1f-674d8ad9b728', '6a65c69c-62d2-47d0-8fca-b2d2e59f2358', '60e25d69-8d91-4202-ae32-55f9e30583b6'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:03 devstack cinder-volume[88026]: DEBUG cinder.quota [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Created reservations ['8aebd24f-4efd-4b3e-bc73-5059fda9d2ee', 'e42ab187-e30e-44a8-a4b1-fa01eb6dc316', '49da6ab7-80bb-4d17-865b-e657e603f5af', '60043079-78f3-4062-8bb6-8fbe47ce3350'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:03 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d 1G" returned: 0 in 0.603s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a010e155-4acc-47e9-acc9-1b2885f79400 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:04 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a010e155-4acc-47e9-acc9-1b2885f79400 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d Sep 11 23:12:04 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:04 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:04 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:04 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:04 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:04 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a010e155-4acc-47e9-acc9-1b2885f79400 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d" returned: 0 in 0.438s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:04 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d is being set with open permissions: ugo+rw Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:04 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.403s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Deleted volume successfully. Sep 11 23:12:04 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d Sep 11 23:12:04 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c881f420-be49-4e5f-9db3-4769b2b93dfb tempest-VolumesGetTest-473659801 None] Lock "cinder-cbae86d4-b1e5-46b2-967e-d283f79d32c5-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:04 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.379s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.manager [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Deleted volume successfully. Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-3a1a69dd-e603-4fd8-9639-0a26f82ba705 req-b0e9b9b9-9ad3-4982-9b40-20c391e0e233 tempest-VolumesSnapshotsTestJSON-1161087993 None] Lock "cinder-37d6c55d-0835-4315-bdbf-0e071614ea22-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:04 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d" returned: 0 in 0.354s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:04 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.info Sep 11 23:12:04 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Lock "cinder-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a1f8b-4b5e-4f7c-8c1e-627df3cb59cc]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:05 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec Sep 11 23:12:05 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:05 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.info" returned: 0 in 0.547s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:05 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.info is being set with open permissions: ugo+rw Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:05 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.info Sep 11 23:12:05 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:05 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" returned: 0 in 0.517s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:05 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec Sep 11 23:12:05 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:05 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.info" returned: 0 in 0.477s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.241s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:05 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3df93596-7428-4067-a53a-5d7f461091d0 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Create snapshot completed successfully Sep 11 23:12:05 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" returned: 0 in 0.386s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec" released by "delete_volume" :: held 0.986s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Created reservations ['9036b65c-ef6b-4346-b148-906f08c24fc0', '89385213-f93b-496b-a7e3-fcfda2a74a9e', '7d27088c-ddfc-40bd-a336-b83296e548ae', 'ce712dbb-b1f7-4754-baa7-120ce33ef2d5'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:06 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:06 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:06 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.268s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Deleted volume successfully. Sep 11 23:12:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-faca84c1-57ca-44f7-9ca1-4de9c537b1b5 tempest-VolumesGetTest-473659801 None] Lock "cinder-9e781d1c-2ecc-4a29-bb05-44bf01ad4aec-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (305f681d-9c8a-4da0-925c-8a16901b823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f694af4-1ab2-4f82-ba9b-57aafd15f3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f694af4-1ab2-4f82-ba9b-57aafd15f3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1340732743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70b0d86-c2bd-409f-9a79-af170f1a9bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:07Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48619245-db8c-491e-828c-74d9d1dd4878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48619245-db8c-491e-828c-74d9d1dd4878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc483fe-7cf3-41aa-bcf1-72300111b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc483fe-7cf3-41aa-bcf1-72300111b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70b0d86-c2bd-409f-9a79-af170f1a9bdd', 'volume_name': 'volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e581624-3eec-4af7-a037-9fbaf635b4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e581624-3eec-4af7-a037-9fbaf635b4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dda5457-d2a3-41e0-aa20-c42e73b95a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:07 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume d70b0d86-c2bd-409f-9a79-af170f1a9bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd', 'volume_size': 1} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1340732743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70b0d86-c2bd-409f-9a79-af170f1a9bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:07Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Creating volume d70b0d86-c2bd-409f-9a79-af170f1a9bdd {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:07 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:07 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd 1073741824 Sep 11 23:12:07 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (929dfaa7-807e-4b23-ae4c-7847e64af0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6b615b-0a5e-4832-8038-5c5f2b352f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6b615b-0a5e-4832-8038-5c5f2b352f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-233263838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91d1e3a-3029-4a12-94bb-b9842a3829e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:08Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:08 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977ab9f1-0e65-498b-b475-0596dcc7b6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977ab9f1-0e65-498b-b475-0596dcc7b6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e8051d-7006-4874-a564-71250bfbd4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e8051d-7006-4874-a564-71250bfbd4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91d1e3a-3029-4a12-94bb-b9842a3829e8', 'volume_name': 'volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24ecdf4-a161-4077-921f-97b79aec5894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24ecdf4-a161-4077-921f-97b79aec5894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7117cf4-3547-4212-8387-d491f29a7706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:08 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume e91d1e3a-3029-4a12-94bb-b9842a3829e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8', 'volume_size': 1} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd 1073741824" returned: 0 in 0.788s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:08 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd Sep 11 23:12:08 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (6960a2c5-ae47-473c-982e-3f48b7449491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037d5143-79e8-48c8-83a4-0dc4f2a905c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037d5143-79e8-48c8-83a4-0dc4f2a905c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1206845578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b46100-155f-424f-84da-e0f4d0ab3f16,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:09Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb1fada-5028-4335-846c-7b7c57519fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb1fada-5028-4335-846c-7b7c57519fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300c51c1-3612-4136-a53b-bd1d7ac52295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:12:08 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd" returned: 0 in 0.410s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-233263838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91d1e3a-3029-4a12-94bb-b9842a3829e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:08Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Creating volume e91d1e3a-3029-4a12-94bb-b9842a3829e8 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:08 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:08 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 1073741824 Sep 11 23:12:08 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dda5457-d2a3-41e0-aa20-c42e73b95a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff927792-4aa4-46d4-85be-b6a98751a908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:09 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd (d70b0d86-c2bd-409f-9a79-af170f1a9bdd): created successfully Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff927792-4aa4-46d4-85be-b6a98751a908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (305f681d-9c8a-4da0-925c-8a16901b823e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-65063e6f-fb0c-4a4e-b236-7d66cf37d0b1 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created volume successfully. Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (ad6c822f-ca13-423f-95a8-d2473ad48467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d34129-c15e-4cb7-87d3-eadf3db3c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d34129-c15e-4cb7-87d3-eadf3db3c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167256273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714d4833-3d46-4e1c-882c-63c05e385523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:09Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b815bceb-80a0-48aa-bbf9-cfc59182c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b815bceb-80a0-48aa-bbf9-cfc59182c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5f4513-252d-4568-a32f-98d24d05b11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5f4513-252d-4568-a32f-98d24d05b11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714d4833-3d46-4e1c-882c-63c05e385523', 'volume_name': 'volume-714d4833-3d46-4e1c-882c-63c05e385523', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1949f32b-2ce6-4b69-8127-94de6322d309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1949f32b-2ce6-4b69-8127-94de6322d309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a269fc46-72ab-49aa-9a59-13c797ab8ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:09 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume 714d4833-3d46-4e1c-882c-63c05e385523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714d4833-3d46-4e1c-882c-63c05e385523', 'volume_size': 1} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300c51c1-3612-4136-a53b-bd1d7ac52295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52b46100-155f-424f-84da-e0f4d0ab3f16', 'volume_name': 'volume-52b46100-155f-424f-84da-e0f4d0ab3f16', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514a062e-a44e-4c12-9011-fd39447453e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514a062e-a44e-4c12-9011-fd39447453e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2938bf05-43b5-41d4-99cc-932fca8e5f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:09 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Volume 52b46100-155f-424f-84da-e0f4d0ab3f16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52b46100-155f-424f-84da-e0f4d0ab3f16', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Trying to clone 52b46100-155f-424f-84da-e0f4d0ab3f16 from image 30dc07db-5049-43e5-a274-fa94fe6ac71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:12:09 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 1073741824" returned: 0 in 0.985s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:10 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 Sep 11 23:12:10 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (b9d6b513-df4a-4a74-852e-13846367501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54a627c-f4ba-48b6-a38e-d475b994e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54a627c-f4ba-48b6-a38e-d475b994e53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1714824418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97da615-dd5e-4e6e-988b-cd316f491542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:10Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ac62b7-a11c-40c9-8411-84b6791d0fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ac62b7-a11c-40c9-8411-84b6791d0fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28e8eb8-9952-4446-b711-2ed90f17929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28e8eb8-9952-4446-b711-2ed90f17929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97da615-dd5e-4e6e-988b-cd316f491542', 'volume_name': 'volume-b97da615-dd5e-4e6e-988b-cd316f491542', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62be549b-86ce-43c4-b410-e85e0f32e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62be549b-86ce-43c4-b410-e85e0f32e16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f9be42-3406-4b69-9885-8dd049a979ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume b97da615-dd5e-4e6e-988b-cd316f491542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97da615-dd5e-4e6e-988b-cd316f491542', 'volume_size': 1} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:10 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8" returned: 0 in 0.510s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167256273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714d4833-3d46-4e1c-882c-63c05e385523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:09Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Creating volume 714d4833-3d46-4e1c-882c-63c05e385523 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:10 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:10 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 1073741824 Sep 11 23:12:10 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:12:10 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (99b061f0-5dda-428b-84b5-f1a83588e0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc294275-1c10-4ab6-a6b3-f1daae18b798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7117cf4-3547-4212-8387-d491f29a7706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a27b36-e7a4-44e9-8d67-16d499203fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc294275-1c10-4ab6-a6b3-f1daae18b798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457574322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c97efdb-efe7-4a59-92d7-8cff3f1759f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:11Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248056e7-4289-4ec9-bb67-2ed7d4e78592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248056e7-4289-4ec9-bb67-2ed7d4e78592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833c5ccc-f56b-43b4-8749-c6cf061a21bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833c5ccc-f56b-43b4-8749-c6cf061a21bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c97efdb-efe7-4a59-92d7-8cff3f1759f9', 'volume_name': 'volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb365b44-08c5-4464-92e9-30ea99643fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb365b44-08c5-4464-92e9-30ea99643fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339db3d1-9a71-451f-8a1a-78caec6a3d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:10 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume 5c97efdb-efe7-4a59-92d7-8cff3f1759f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9', 'volume_size': 1} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ad9566-87a5-4c03-8e48-52dbb8596eaa]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:10 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 (e91d1e3a-3029-4a12-94bb-b9842a3829e8): created successfully Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a27b36-e7a4-44e9-8d67-16d499203fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (929dfaa7-807e-4b23-ae4c-7847e64af0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:10 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-bbc7b765-cce2-461d-b4c2-f35375dccf5c tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created volume successfully. Sep 11 23:12:10 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD Sep 11 23:12:10 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:11 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 1073741824" returned: 0 in 0.597s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:11 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d is fetched for user 404724b610364c498c51798367bf24ff. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:11 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 Sep 11 23:12:11 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8634f4-bc58-4c16-b783-efbb1818d47b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:11 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:11 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:11 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD Sep 11 23:12:11 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:11 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523" returned: 0 in 0.322s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1714824418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97da615-dd5e-4e6e-988b-cd316f491542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:10Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Creating volume b97da615-dd5e-4e6e-988b-cd316f491542 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:11 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:11 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 1073741824 Sep 11 23:12:11 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a269fc46-72ab-49aa-9a59-13c797ab8ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714d4833-3d46-4e1c-882c-63c05e385523', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087b711b-d12b-40fb-9caa-f982caa98f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:11 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume volume-714d4833-3d46-4e1c-882c-63c05e385523 (714d4833-3d46-4e1c-882c-63c05e385523): created successfully Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087b711b-d12b-40fb-9caa-f982caa98f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (ad6c822f-ca13-423f-95a8-d2473ad48467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:11 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-55210833-c744-4ec8-89c9-c423efa72376 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created volume successfully. Sep 11 23:12:11 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:11 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.514s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:12:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:12:12 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 1073741824" returned: 0 in 0.617s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:12 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 Sep 11 23:12:12 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:12 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542" returned: 0 in 0.290s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457574322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c97efdb-efe7-4a59-92d7-8cff3f1759f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa8be8584504948873cd6adef02ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:11Z,use_quota=True,user_id='915243af2ea74328a9ae52a7d13c3410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Creating volume 5c97efdb-efe7-4a59-92d7-8cff3f1759f9 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:12 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f9be42-3406-4b69-9885-8dd049a979ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97da615-dd5e-4e6e-988b-cd316f491542', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7e7506-5360-4d2c-b419-61d540917b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:12 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 1073741824 Sep 11 23:12:12 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:12 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume volume-b97da615-dd5e-4e6e-988b-cd316f491542 (b97da615-dd5e-4e6e-988b-cd316f491542): created successfully Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7e7506-5360-4d2c-b419-61d540917b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (b9d6b513-df4a-4a74-852e-13846367501a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:12 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-48b64f2c-e843-4a3f-93d2-33fee8ab67df tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created volume successfully. Sep 11 23:12:13 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 1073741824" returned: 0 in 0.652s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:13 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 Sep 11 23:12:13 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:13 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9" returned: 0 in 0.272s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.653s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1206845578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b46100-155f-424f-84da-e0f4d0ab3f16,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:09Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Creating volume 52b46100-155f-424f-84da-e0f4d0ab3f16 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:13 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:13 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 1073741824 Sep 11 23:12:13 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339db3d1-9a71-451f-8a1a-78caec6a3d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4906e0-d80b-4fa4-8f8e-ec45f35b9f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Volume volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 (5c97efdb-efe7-4a59-92d7-8cff3f1759f9): created successfully Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4906e0-d80b-4fa4-8f8e-ec45f35b9f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Flow 'volume_create_manager' (99b061f0-5dda-428b-84b5-f1a83588e0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:13 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4f35cb22-60be-4930-a6f5-dc1bc04fbd06 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created volume successfully. Sep 11 23:12:14 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 1073741824" returned: 0 in 0.662s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-5c97efdb-efe7-4a59-92d7-8cff3f1759f9-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-5c97efdb-efe7-4a59-92d7-8cff3f1759f9-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:14 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 Sep 11 23:12:14 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-quobyte-5c97efdb-efe7-4a59-92d7-8cff3f1759f9" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-5c97efdb-efe7-4a59-92d7-8cff3f1759f9" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7d3fd5-b4ea-45d6-b2fb-7b02d78524ea]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:14 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 Sep 11 23:12:14 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:14 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16" returned: 0 in 0.330s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Attempting download of 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 52b46100-155f-424f-84da-e0f4d0ab3f16. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab41a14-af2d-41c5-937c-4941968d726f]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_7qm5ejvg {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:14 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_7qm5ejvg Sep 11 23:12:14 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:15 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9" returned: 0 in 0.536s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:15 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9 Sep 11 23:12:15 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:15 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_7qm5ejvg" returned: 0 in 0.401s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_7qm5ejvg {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:15 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5c97efdb-efe7-4a59-92d7-8cff3f1759f9" returned: 0 in 0.336s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:15 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_7qm5ejvg Sep 11 23:12:15 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-5c97efdb-efe7-4a59-92d7-8cff3f1759f9" released by "delete_volume" :: held 0.932s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created reservations ['92cd249f-63a8-444e-ac18-e88adc003a4b', '95822d06-135e-47f5-9681-c61c87e65c6d', '2209ecfd-2405-4fc1-b6a7-fc58f4649fca', '059f557d-61b9-408b-b970-542ce78b12ad'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:15 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:15 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:15 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_7qm5ejvg" returned: 1 in 0.468s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_7qm5ejvg' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f10ee4-8bda-468d-b608-79247b3f20c4]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:15 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD Sep 11 23:12:15 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:15 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.307s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:15 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Deleted volume successfully. Sep 11 23:12:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-087c6bbe-6301-46b9-98fa-586cfacfc476 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-5c97efdb-efe7-4a59-92d7-8cff3f1759f9-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:16 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] 30dc07db-5049-43e5-a274-fa94fe6ac71d was qcow2, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:16 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 Sep 11 23:12:16 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-b97da615-dd5e-4e6e-988b-cd316f491542-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-b97da615-dd5e-4e6e-988b-cd316f491542-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-quobyte-b97da615-dd5e-4e6e-988b-cd316f491542" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-b97da615-dd5e-4e6e-988b-cd316f491542" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ad7492-479d-4d5e-a532-480188931beb]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:16 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 Sep 11 23:12:16 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:17 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542" returned: 0 in 0.576s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:17 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542 Sep 11 23:12:17 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:17 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b97da615-dd5e-4e6e-988b-cd316f491542" returned: 0 in 0.419s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-b97da615-dd5e-4e6e-988b-cd316f491542" released by "delete_volume" :: held 1.060s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:17 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created reservations ['46dc0c3d-9242-4f26-9904-b13c60baeb93', '93da2db9-1cce-41a5-afab-4ab738d70458', 'd4dafe08-4994-455f-9f72-74373e5fabf7', '121e5c2a-5ae5-461e-b7b9-233e3d59d2fa'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:18 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:18 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:18 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.340s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Deleted volume successfully. Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-14018c59-4785-4214-87ff-9a7a2177051d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-b97da615-dd5e-4e6e-988b-cd316f491542-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:18 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16" returned: 0 in 2.647s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_siwimptpdevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:12:18 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Converted 112.00 MB image at 42.30 MB/s Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:18 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 1G Sep 11 23:12:18 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-714d4833-3d46-4e1c-882c-63c05e385523-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-714d4833-3d46-4e1c-882c-63c05e385523-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-quobyte-714d4833-3d46-4e1c-882c-63c05e385523" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-714d4833-3d46-4e1c-882c-63c05e385523" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab575149-2e5a-426b-8408-1adc18dfa082]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:19 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 Sep 11 23:12:19 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:19 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 1G" returned: 0 in 0.614s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Downloaded image 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 52b46100-155f-424f-84da-e0f4d0ab3f16 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d for user 404724b610364c498c51798367bf24ff is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Marking volume 52b46100-155f-424f-84da-e0f4d0ab3f16 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Copying metadata from image 30dc07db-5049-43e5-a274-fa94fe6ac71d to 52b46100-155f-424f-84da-e0f4d0ab3f16. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Creating volume glance metadata for volume 52b46100-155f-424f-84da-e0f4d0ab3f16 backed by image 30dc07db-5049-43e5-a274-fa94fe6ac71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2938bf05-43b5-41d4-99cc-932fca8e5f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b46100-155f-424f-84da-e0f4d0ab3f16', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4703168e-a120-4af3-bc26-fbfb8ee1ec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:19 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Volume volume-52b46100-155f-424f-84da-e0f4d0ab3f16 (52b46100-155f-424f-84da-e0f4d0ab3f16): created successfully Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4703168e-a120-4af3-bc26-fbfb8ee1ec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (6960a2c5-ae47-473c-982e-3f48b7449491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:19 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-95866ae3-2cfd-462c-b9e4-4bbd4f8a9ecf tempest-VolumesGetTest-473659801 None] Created volume successfully. Sep 11 23:12:19 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523" returned: 0 in 0.591s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:19 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523 Sep 11 23:12:19 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:20 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-714d4833-3d46-4e1c-882c-63c05e385523" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-714d4833-3d46-4e1c-882c-63c05e385523" released by "delete_volume" :: held 1.085s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created reservations ['83edb346-de7b-4150-86d9-ab07d6f8b3cb', '0cd7b894-550b-4c9b-8254-04dd49009319', '47087e2a-0729-47ba-a92b-c0f10404137b', '2437b8e3-6ab9-4973-af0f-ed52547045d0'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:20 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:20 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:20 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.385s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Deleted volume successfully. Sep 11 23:12:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3bfb26de-c4cf-4612-a2fa-7d820c5079dd tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-714d4833-3d46-4e1c-882c-63c05e385523-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-e91d1e3a-3029-4a12-94bb-b9842a3829e8-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-e91d1e3a-3029-4a12-94bb-b9842a3829e8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-quobyte-e91d1e3a-3029-4a12-94bb-b9842a3829e8" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-e91d1e3a-3029-4a12-94bb-b9842a3829e8" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaa2033-b3b5-40d5-af47-e3bea61c071f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:21 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 Sep 11 23:12:21 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (68554afe-f69f-4b52-8454-82b5ad313952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4e3c3b-78ad-4a8e-b4af-e115a95fc7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4e3c3b-78ad-4a8e-b4af-e115a95fc7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1947651768',display_name='tempest-VolumesGetTest-Volume-1535639161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:22Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eaddd07-86ef-4863-a735-4d1481509562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eaddd07-86ef-4863-a735-4d1481509562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec417154-4349-432e-b643-9433e8ab518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec417154-4349-432e-b643-9433e8ab518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f', 'volume_name': 'volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc4bd15-7a11-4395-9fbe-3c49cf9f0ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc4bd15-7a11-4395-9fbe-3c49cf9f0ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0632ca-275f-44dc-81c5-3408854a7a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:21 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Volume 12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f', 'volume_size': 1} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1947651768',display_name='tempest-VolumesGetTest-Volume-1535639161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='465f0f901d2b4dbd9ed824ccb11d84ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:22Z,use_quota=True,user_id='404724b610364c498c51798367bf24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Creating volume 12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:22 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:22 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f 1073741824 Sep 11 23:12:22 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:22 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8" returned: 0 in 0.641s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:22 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8 Sep 11 23:12:22 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:22 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e91d1e3a-3029-4a12-94bb-b9842a3829e8" returned: 0 in 0.351s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:22 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-e91d1e3a-3029-4a12-94bb-b9842a3829e8" released by "delete_volume" :: held 1.071s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f 1073741824" returned: 0 in 0.633s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=138,cinder:INSERT=49,cinder:UPDATE=178,cinder:DELETE=19 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:22 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f Sep 11 23:12:22 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created reservations ['80aed727-d568-439d-aaeb-95ceca5865a2', '82cef52c-8da9-4882-9812-af943aeeac6c', 'a9f88bb1-c22d-44cb-99c0-6c42a54ab3e6', 'd240bd89-e49d-4411-878e-365b9f7c1844'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:22 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:22 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:23 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f" returned: 0 in 0.349s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0632ca-275f-44dc-81c5-3408854a7a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2e231d-4487-4800-b5bf-184bf7bc8595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:23 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Volume volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f (12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f): created successfully Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2e231d-4487-4800-b5bf-184bf7bc8595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Flow 'volume_create_manager' (68554afe-f69f-4b52-8454-82b5ad313952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:23 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f5eaf3d6-1e4c-455a-9c8b-ad47c433a884 tempest-VolumesGetTest-473659801 None] Created volume successfully. Sep 11 23:12:23 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.339s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:23 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Deleted volume successfully. Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0160c2f3-897c-40ed-8a4a-07a9ffef2698 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-e91d1e3a-3029-4a12-94bb-b9842a3829e8-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-d70b0d86-c2bd-409f-9a79-af170f1a9bdd-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-d70b0d86-c2bd-409f-9a79-af170f1a9bdd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-quobyte-d70b0d86-c2bd-409f-9a79-af170f1a9bdd" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-d70b0d86-c2bd-409f-9a79-af170f1a9bdd" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e97a574-4ce3-41fa-83fa-d84a4cffb025]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:24 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd Sep 11 23:12:24 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Lock "cinder-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a099354-283b-4ce4-90e4-b296c8a2ad6b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:24 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd" returned: 0 in 0.493s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:24 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd Sep 11 23:12:24 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:24 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f Sep 11 23:12:24 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:24 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:24 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f" returned: 0 in 0.527s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d70b0d86-c2bd-409f-9a79-af170f1a9bdd" returned: 0 in 0.484s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-d70b0d86-c2bd-409f-9a79-af170f1a9bdd" released by "delete_volume" :: held 1.078s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:24 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f Sep 11 23:12:24 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:24 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created reservations ['f8d81b79-aaa3-4ab4-8ec5-4f8542001b34', '7700382a-53a3-4fc3-a9d0-77a12507a357', '01406847-4ccd-4a27-8dda-e34527349cfd', 'a2380c10-da1f-4271-86a0-30aa768c2eb5'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:25 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:25 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:25 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f" returned: 0 in 0.381s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f" released by "delete_volume" :: held 0.976s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Created reservations ['42e9c088-ee41-4107-940e-221a0db2f0f8', 'c4c99a56-51ee-4038-824f-28d4d8a28cb1', '65d4aea8-4a08-4040-8043-7c2d0dfe0337', '4e74eb44-a6df-4c3c-aa92-91bd0eb3d44d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:25 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:25 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:25 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.383s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Deleted volume successfully. Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b9e20ee0-24e9-4ae7-9ce8-3cdec5a2bb2d tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-d70b0d86-c2bd-409f-9a79-af170f1a9bdd-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:25 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.337s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Deleted volume successfully. Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1c6cbd72-f6d2-4600-abc0-c64291467502 tempest-VolumesGetTest-473659801 None] Lock "cinder-12ddb54b-a9f9-4e1c-a9e8-57df1a0e611f-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-db8af5e8-2df0-46a6-ba15-d299bae4366d-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-db8af5e8-2df0-46a6-ba15-d299bae4366d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-quobyte-a010e155-4acc-47e9-acc9-1b2885f79400" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-a010e155-4acc-47e9-acc9-1b2885f79400" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-quobyte-db8af5e8-2df0-46a6-ba15-d299bae4366d" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-db8af5e8-2df0-46a6-ba15-d299bae4366d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Deleting offline snapshot db8af5e8-2df0-46a6-ba15-d299bae4366d of volume a010e155-4acc-47e9-acc9-1b2885f79400 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] snapshot_file for this snap is: volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a22f64a-2e3e-4b67-b4f8-849fb100a138]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:26 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d Sep 11 23:12:26 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-52b46100-155f-424f-84da-e0f4d0ab3f16-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Lock "cinder-52b46100-155f-424f-84da-e0f4d0ab3f16-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:26 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d" returned: 0 in 0.625s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a010e155-4acc-47e9-acc9-1b2885f79400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[49168b10-c95f-4e91-b138-8265f0bfac47]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Acquiring lock "cinder-quobyte-52b46100-155f-424f-84da-e0f4d0ab3f16" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-52b46100-155f-424f-84da-e0f4d0ab3f16" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9efcb5a-04bf-48c6-802a-116bcf24f2be]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:26 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 Sep 11 23:12:26 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:27 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 Sep 11 23:12:27 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:27 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400" returned: 0 in 0.467s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:27 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d Sep 11 23:12:27 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:27 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16" returned: 0 in 0.538s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:27 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16 Sep 11 23:12:27 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:27 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d" returned: 0 in 0.478s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:27 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:27 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-52b46100-155f-424f-84da-e0f4d0ab3f16" returned: 0 in 0.369s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:27 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Lock "cinder-quobyte-52b46100-155f-424f-84da-e0f4d0ab3f16" released by "delete_volume" :: held 0.980s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Created reservations ['cb564e92-1e31-4a44-8704-72d61316cc45', 'cb8af057-446d-4f19-bc30-6e6ddf7bd2ad', 'b29a3c4d-28fb-4085-9496-55645bbd692d', '6a4db6e3-d0f4-4a31-9c0d-8971364820fd'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:28 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:28 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:28 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400.db8af5e8-2df0-46a6-ba15-d299bae4366d" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-db8af5e8-2df0-46a6-ba15-d299bae4366d" released by "_delete_snapshot" :: held 2.057s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-a010e155-4acc-47e9-acc9-1b2885f79400" released by "delete_snapshot" :: held 2.082s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created reservations ['67a40ebf-ed33-4682-89b0-48e36b9ae8e0', '84a249f7-0da4-44a1-84a3-e5975f061672', '0efba63b-43bf-4ac8-8457-c91ff5668330', 'e7ebb2a8-1488-4a75-974a-ce0925ae109d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:28 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:28 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Delete snapshot completed successfully. Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.337s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eba06a43-c829-465e-a2cc-60523468f0b5 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-db8af5e8-2df0-46a6-ba15-d299bae4366d-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:28 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Deleted volume successfully. Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b426965-fe7e-4de1-8905-67e0edc9f1ee tempest-VolumesGetTest-473659801 None] Lock "cinder-52b46100-155f-424f-84da-e0f4d0ab3f16-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Flow 'volume_create_manager' (fd9ae765-6d28-4b94-a851-ed36d71110c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa39c0a4-3e5f-4730-af15-06da24c9e9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa39c0a4-3e5f-4730-af15-06da24c9e9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1390590531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756ae783-558a-4a18-bb9b-dc3720ec2592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f42ec0e1da8449593c042bec4eadf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:29Z,use_quota=True,user_id='da8172fc5bfc445fa7dc0cc022d637a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce78329-88cc-410b-9782-1f8252297666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce78329-88cc-410b-9782-1f8252297666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7669e474-d3de-42be-a142-ba2e371ea2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:28 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-a010e155-4acc-47e9-acc9-1b2885f79400-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-a010e155-4acc-47e9-acc9-1b2885f79400-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7669e474-d3de-42be-a142-ba2e371ea2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '756ae783-558a-4a18-bb9b-dc3720ec2592', 'volume_name': 'volume-756ae783-558a-4a18-bb9b-dc3720ec2592', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc84482-3054-4831-af8e-af8019bd6271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc84482-3054-4831-af8e-af8019bd6271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b3604e-8f2f-41d8-baa2-04bfd914f934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:29 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Volume 756ae783-558a-4a18-bb9b-dc3720ec2592: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-756ae783-558a-4a18-bb9b-dc3720ec2592', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Trying to clone 756ae783-558a-4a18-bb9b-dc3720ec2592 from image 30dc07db-5049-43e5-a274-fa94fe6ac71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "cinder-quobyte-a010e155-4acc-47e9-acc9-1b2885f79400" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-a010e155-4acc-47e9-acc9-1b2885f79400" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2386bc04-473e-402e-857d-1feeed9eb1aa]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:29 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 Sep 11 23:12:29 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:12:30 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Image download 20.69 MB at 20.69 MB/s Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fb6927-1e24-4b64-8735-f415f875818b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:30 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400" returned: 0 in 0.546s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:30 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400 Sep 11 23:12:30 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:30 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD Sep 11 23:12:30 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:30 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a010e155-4acc-47e9-acc9-1b2885f79400" returned: 0 in 0.427s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-quobyte-a010e155-4acc-47e9-acc9-1b2885f79400" released by "delete_volume" :: held 1.084s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:30 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d is fetched for user da8172fc5bfc445fa7dc0cc022d637a5. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Created reservations ['01d06bfc-9f16-4ac8-9e23-7d6194d5e126', 'fe97d85e-5a22-4442-972e-177ffb4a6cd2', '36afdd63-1012-46f6-8d4b-4c21cb0f85da', 'ec526a7b-9895-4a5b-a2bf-ebe515cd2828'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7894f25e-828a-425c-a750-544012f605a1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:30 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:30 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:30 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD Sep 11 23:12:30 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:31 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.311s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:31 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Deleted volume successfully. Sep 11 23:12:31 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1390590531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756ae783-558a-4a18-bb9b-dc3720ec2592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f42ec0e1da8449593c042bec4eadf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:29Z,use_quota=True,user_id='da8172fc5bfc445fa7dc0cc022d637a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Creating volume 756ae783-558a-4a18-bb9b-dc3720ec2592 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:31 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-591d264f-fc5b-4932-a050-f88b55d50342 tempest-CreateVolumesFromSnapshotTest-1831121332 None] Lock "cinder-a010e155-4acc-47e9-acc9-1b2885f79400-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:31 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 1073741824 Sep 11 23:12:31 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Flow 'volume_create_manager' (56fe1647-8d82-4241-822d-89911ca80e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0263b5d3-c9dd-44a9-99e0-585d4dac229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0263b5d3-c9dd-44a9-99e0-585d4dac229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-208903201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5568bc4-44ab-4312-b225-e9679e2a0a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d9b7e856f9489abb69d5330609ae46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:32Z,use_quota=True,user_id='7b350ee0afd14894a0abe9266fef470e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f24911c-b393-44a2-9636-42a914551518),volume_type_id=0f24911c-b393-44a2-9636-42a914551518)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a99f39-788c-4260-b77f-ecda3bed5250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a99f39-788c-4260-b77f-ecda3bed5250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbca69c-0104-4d87-93f9-5777c0d27902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbca69c-0104-4d87-93f9-5777c0d27902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5568bc4-44ab-4312-b225-e9679e2a0a3b', 'volume_name': 'volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707ae493-a374-435e-bec6-c67869302003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707ae493-a374-435e-bec6-c67869302003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1716c378-dff9-4c25-8869-0ae3e531dd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:31 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Volume d5568bc4-44ab-4312-b225-e9679e2a0a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b', 'volume_size': 1} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:31 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 1073741824" returned: 0 in 0.706s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:32 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 Sep 11 23:12:32 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:32 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592" returned: 0 in 0.319s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-208903201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5568bc4-44ab-4312-b225-e9679e2a0a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d9b7e856f9489abb69d5330609ae46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:32Z,use_quota=True,user_id='7b350ee0afd14894a0abe9266fef470e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f24911c-b393-44a2-9636-42a914551518),volume_type_id=0f24911c-b393-44a2-9636-42a914551518)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Creating volume d5568bc4-44ab-4312-b225-e9679e2a0a3b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:32 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:32 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b 1073741824 Sep 11 23:12:32 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Attempting download of 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 756ae783-558a-4a18-bb9b-dc3720ec2592. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb18514-ac89-44e4-9e60-4c718679a527]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_wz88p4cm {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:32 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_wz88p4cm Sep 11 23:12:32 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:32 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_wz88p4cm" returned: 0 in 0.482s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_wz88p4cm {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:32 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b 1073741824" returned: 0 in 0.661s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:33 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b Sep 11 23:12:33 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:33 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_wz88p4cm Sep 11 23:12:33 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:33 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b" returned: 0 in 0.338s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1716c378-dff9-4c25-8869-0ae3e531dd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fea361-689d-4bd1-b2ca-10dda4c43b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:33 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Volume volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b (d5568bc4-44ab-4312-b225-e9679e2a0a3b): created successfully Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fea361-689d-4bd1-b2ca-10dda4c43b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Flow 'volume_create_manager' (56fe1647-8d82-4241-822d-89911ca80e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:33 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_wz88p4cm" returned: 1 in 0.531s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30dc07db-5049-43e5-a274-fa94fe6ac71d_wz88p4cm' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded3cd3-d875-4085-8531-ed350f951539]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7f28f14e-92a1-46be-aa31-18f7d485c9f4 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Created volume successfully. Sep 11 23:12:33 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD Sep 11 23:12:33 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:33 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] 30dc07db-5049-43e5-a274-fa94fe6ac71d was qcow2, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:12:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:33 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 Sep 11 23:12:33 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:34 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:34 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:34 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.358s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ae6a3137-5006-4f97-aa58-426a2a9fde15 tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Retype volume completed successfully. Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Flow 'volume_create_manager' (f3005135-5700-49df-9a8b-7df25b885f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9297ef91-7ab4-442c-b110-26117767aa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9297ef91-7ab4-442c-b110-26117767aa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2116008352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef7e652-aaa3-4225-89f4-11d3213ff607,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11f330af107448558ba6499f5e7e8e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:35Z,use_quota=True,user_id='7c99941a43d4463ea50e9fa751c94675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d467b28f-db52-439f-b120-81eb40ff0e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d467b28f-db52-439f-b120-81eb40ff0e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ae7b5f-42f0-4e07-9e29-166f839c5e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ae7b5f-42f0-4e07-9e29-166f839c5e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef7e652-aaa3-4225-89f4-11d3213ff607', 'volume_name': 'volume-6ef7e652-aaa3-4225-89f4-11d3213ff607', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d542dd32-42f6-4f97-b8d8-c2de20569d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d542dd32-42f6-4f97-b8d8-c2de20569d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea106111-42c6-4e2a-8fea-61ae11ddaafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:35 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Volume 6ef7e652-aaa3-4225-89f4-11d3213ff607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef7e652-aaa3-4225-89f4-11d3213ff607', 'volume_size': 1} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2116008352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef7e652-aaa3-4225-89f4-11d3213ff607,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11f330af107448558ba6499f5e7e8e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:35Z,use_quota=True,user_id='7c99941a43d4463ea50e9fa751c94675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Creating volume 6ef7e652-aaa3-4225-89f4-11d3213ff607 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:35 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:35 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 1073741824 Sep 11 23:12:35 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Acquiring lock "cinder-d5568bc4-44ab-4312-b225-e9679e2a0a3b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "cinder-d5568bc4-44ab-4312-b225-e9679e2a0a3b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Acquiring lock "cinder-quobyte-d5568bc4-44ab-4312-b225-e9679e2a0a3b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "cinder-quobyte-d5568bc4-44ab-4312-b225-e9679e2a0a3b" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08aa1f1-3ccd-42ad-b9a6-85c1a139ff2c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:35 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 1073741824" returned: 0 in 0.724s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:35 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 Sep 11 23:12:35 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:35 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b Sep 11 23:12:35 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:36 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607" returned: 0 in 0.285s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea106111-42c6-4e2a-8fea-61ae11ddaafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef7e652-aaa3-4225-89f4-11d3213ff607', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbfbeb9-2e48-4823-9182-9af4923edc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:36 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Volume volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 (6ef7e652-aaa3-4225-89f4-11d3213ff607): created successfully Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbfbeb9-2e48-4823-9182-9af4923edc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Flow 'volume_create_manager' (f3005135-5700-49df-9a8b-7df25b885f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:36 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a0dce6f6-1983-4dbc-94e3-02de4297ab15 tempest-VolumesListTestJSON-620578116 None] Created volume successfully. Sep 11 23:12:36 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b" returned: 0 in 0.593s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:36 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b Sep 11 23:12:36 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:36 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592" returned: 0 in 2.465s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30dc07db-5049-43e5-a274-fa94fe6ac71d_3ln7jbfhdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:12:36 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Converted 112.00 MB image at 45.42 MB/s Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:36 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 1G Sep 11 23:12:36 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:36 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5568bc4-44ab-4312-b225-e9679e2a0a3b" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "cinder-quobyte-d5568bc4-44ab-4312-b225-e9679e2a0a3b" released by "delete_volume" :: held 0.931s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:36 devstack cinder-volume[88026]: WARNING cinder.quota [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:12:36 devstack cinder-volume[88026]: WARNING cinder.quota [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Created reservations ['4098b4c5-82da-4039-8572-4c1864b75920', 'b624980a-0917-485f-bd25-4dfa347a2c4a', 'bede5c1b-079f-4eda-b63f-001334f17a33', 'd369401a-ef10-4e71-8c00-f85f52218c47'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:36 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:36 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:36 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 1G" returned: 0 in 0.426s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Downloaded image 30dc07db-5049-43e5-a274-fa94fe6ac71d ((None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}])) to volume 756ae783-558a-4a18-bb9b-dc3720ec2592 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Temporary image 30dc07db-5049-43e5-a274-fa94fe6ac71d for user da8172fc5bfc445fa7dc0cc022d637a5 is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Marking volume 756ae783-558a-4a18-bb9b-dc3720ec2592 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Copying metadata from image 30dc07db-5049-43e5-a274-fa94fe6ac71d to 756ae783-558a-4a18-bb9b-dc3720ec2592. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Creating volume glance metadata for volume 756ae783-558a-4a18-bb9b-dc3720ec2592 backed by image 30dc07db-5049-43e5-a274-fa94fe6ac71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b3604e-8f2f-41d8-baa2-04bfd914f934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756ae783-558a-4a18-bb9b-dc3720ec2592', 'volume_size': 1, 'image_id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30dc07db-5049-43e5-a274-fa94fe6ac71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61aee62e42014924a1d5267ed3ae7637', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30dc07db-5049-43e5-a274-fa94fe6ac71d', 'created_at': datetime.datetime(2026, 9, 11, 20, 54, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30dc07db-5049-43e5-a274-fa94fe6ac71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456062a7-8d17-47f0-af65-3c23df979e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:37 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Volume volume-756ae783-558a-4a18-bb9b-dc3720ec2592 (756ae783-558a-4a18-bb9b-dc3720ec2592): created successfully Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456062a7-8d17-47f0-af65-3c23df979e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Flow 'volume_create_manager' (fd9ae765-6d28-4b94-a851-ed36d71110c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-04248d7c-4980-4067-b93c-f6c4ce7e761d tempest-TestShelveInstance-919859006 None] Created volume successfully. Sep 11 23:12:37 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.296s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Deleted volume successfully. Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eae14389-83d9-4a04-9c3b-a55bf5d7114b tempest-VolumeRetypeWithoutMigrationTest-1863994584 None] Lock "cinder-d5568bc4-44ab-4312-b225-e9679e2a0a3b-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Flow 'volume_create_manager' (f5cc6c7c-f68e-4f61-9b6b-3146e992d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c29afb-cf21-4ec4-8b11-7cf26f4c6cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c29afb-cf21-4ec4-8b11-7cf26f4c6cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-914276370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ef9163-00a6-4cd5-85b1-22e4a09ba82b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11f330af107448558ba6499f5e7e8e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:38Z,use_quota=True,user_id='7c99941a43d4463ea50e9fa751c94675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944352ad-20ad-4996-89c8-4a58703eb6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944352ad-20ad-4996-89c8-4a58703eb6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7702c49-0d22-4062-a657-8389931f8a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7702c49-0d22-4062-a657-8389931f8a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ef9163-00a6-4cd5-85b1-22e4a09ba82b', 'volume_name': 'volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2211f7f3-47a7-456f-9910-d10696b452c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2211f7f3-47a7-456f-9910-d10696b452c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9eb911b-e348-4ef6-9224-8c55f1703f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:37 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Volume a9ef9163-00a6-4cd5-85b1-22e4a09ba82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b', 'volume_size': 1} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-914276370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ef9163-00a6-4cd5-85b1-22e4a09ba82b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11f330af107448558ba6499f5e7e8e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:38Z,use_quota=True,user_id='7c99941a43d4463ea50e9fa751c94675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Creating volume a9ef9163-00a6-4cd5-85b1-22e4a09ba82b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:37 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:37 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b 1073741824 Sep 11 23:12:37 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:38 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b 1073741824" returned: 0 in 0.546s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:38 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b Sep 11 23:12:38 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:38 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9eb911b-e348-4ef6-9224-8c55f1703f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ca7b71-1a9e-4559-a8c4-9fe180f3b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:38 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Volume volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b (a9ef9163-00a6-4cd5-85b1-22e4a09ba82b): created successfully Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ca7b71-1a9e-4559-a8c4-9fe180f3b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Flow 'volume_create_manager' (f5cc6c7c-f68e-4f61-9b6b-3146e992d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:38 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ce76c8e5-aafc-4d86-8fa2-b8d43f5f81e9 tempest-VolumesListTestJSON-620578116 None] Created volume successfully. Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Flow 'volume_create_manager' (a7c35b2d-d97d-4109-87f6-89177f8e343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d64ff21-6a18-4ae0-93b1-c7884074a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d64ff21-6a18-4ae0-93b1-c7884074a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-648304878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1b9e2e-f703-4f8c-b609-d02c8443473d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11f330af107448558ba6499f5e7e8e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:41Z,use_quota=True,user_id='7c99941a43d4463ea50e9fa751c94675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dffe7c-8cca-4b43-810b-c31963fd5fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dffe7c-8cca-4b43-810b-c31963fd5fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a98d6ae-18c5-4d98-8af2-84c793d67203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a98d6ae-18c5-4d98-8af2-84c793d67203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee1b9e2e-f703-4f8c-b609-d02c8443473d', 'volume_name': 'volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d566a11-9ee1-4944-8d8f-d821611e099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d566a11-9ee1-4944-8d8f-d821611e099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980ec870-a2d4-4348-9f4a-7fb659ab5b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:40 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Volume ee1b9e2e-f703-4f8c-b609-d02c8443473d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d', 'volume_size': 1} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-648304878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1b9e2e-f703-4f8c-b609-d02c8443473d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11f330af107448558ba6499f5e7e8e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:41Z,use_quota=True,user_id='7c99941a43d4463ea50e9fa751c94675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Creating volume ee1b9e2e-f703-4f8c-b609-d02c8443473d {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:12:40 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:12:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:40 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d 1073741824 Sep 11 23:12:40 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:41 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d 1073741824" returned: 0 in 0.658s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:41 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d Sep 11 23:12:41 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:41 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d" returned: 0 in 0.352s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980ec870-a2d4-4348-9f4a-7fb659ab5b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e504b00-1466-4629-bf1d-0960c862a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-916a3205-c120-44ea-9d75-7eb89808a89c req-5003bf0e-ef30-4bce-9d24-e0a5ebde62cf tempest-TestShelveInstance-919859006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-916a3205-c120-44ea-9d75-7eb89808a89c req-5003bf0e-ef30-4bce-9d24-e0a5ebde62cf tempest-TestShelveInstance-919859006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-916a3205-c120-44ea-9d75-7eb89808a89c req-5003bf0e-ef30-4bce-9d24-e0a5ebde62cf tempest-TestShelveInstance-919859006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Volume volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d (ee1b9e2e-f703-4f8c-b609-d02c8443473d): created successfully Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e504b00-1466-4629-bf1d-0960c862a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:12:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Flow 'volume_create_manager' (a7c35b2d-d97d-4109-87f6-89177f8e343c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:12:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c2944263-7393-47cf-9c22-0877440318c2 tempest-VolumesListTestJSON-620578116 None] Created volume successfully. Sep 11 23:12:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-916a3205-c120-44ea-9d75-7eb89808a89c req-5003bf0e-ef30-4bce-9d24-e0a5ebde62cf tempest-TestShelveInstance-919859006 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-756ae783-558a-4a18-bb9b-dc3720ec2592', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c32c167-c98f-4ea2-ab74-474135a07275', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:12:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-916a3205-c120-44ea-9d75-7eb89808a89c req-5003bf0e-ef30-4bce-9d24-e0a5ebde62cf tempest-TestShelveInstance-919859006 None] attachment_update completed successfully. Sep 11 23:12:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "cinder-ee1b9e2e-f703-4f8c-b609-d02c8443473d-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-ee1b9e2e-f703-4f8c-b609-d02c8443473d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "cinder-quobyte-ee1b9e2e-f703-4f8c-b609-d02c8443473d" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-quobyte-ee1b9e2e-f703-4f8c-b609-d02c8443473d" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:45 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c4ade1-3da4-42c2-879f-8f4ddeae2efe]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:45 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d Sep 11 23:12:45 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:46 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d" returned: 0 in 0.530s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:46 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d Sep 11 23:12:46 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:46 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ee1b9e2e-f703-4f8c-b609-d02c8443473d" returned: 0 in 0.336s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-quobyte-ee1b9e2e-f703-4f8c-b609-d02c8443473d" released by "delete_volume" :: held 0.935s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Created reservations ['e3a670d6-5ebc-4bb8-a209-4b6c6ac0e825', '09251c21-1104-424e-8112-16571a169d5b', 'eaceaf50-8f22-4ead-aaf5-3479d8fb0cae', '996dd1ab-8c24-46f2-aab5-6ce09de8792b'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:46 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:46 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:47 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.357s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:47 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Deleted volume successfully. Sep 11 23:12:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eee98a44-39c9-48b7-8e98-a325f1b7e3d6 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-ee1b9e2e-f703-4f8c-b609-d02c8443473d-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "cinder-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "cinder-quobyte-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-quobyte-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:48 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6227da-987f-48df-b22a-28125a89bc17]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:48 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b Sep 11 23:12:48 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:48 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b" returned: 0 in 0.732s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:48 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b Sep 11 23:12:48 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:49 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-quobyte-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b" released by "delete_volume" :: held 1.252s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Created reservations ['7ce1d857-2ed8-4d8f-9eaf-7be08dfc2ae4', '9f6cc1c8-3c9d-4d89-8302-0968da61e9ce', '941bfa16-2f4b-4f7a-bb32-e4dd29db5b2f', '5f2d6ad7-fe43-4db8-92a3-a77d84d1bc78'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:49 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:49 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:50 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.356s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Deleted volume successfully. Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e17cd48b-c17b-4236-932f-76f2120dc1f6 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-a9ef9163-00a6-4cd5-85b1-22e4a09ba82b-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "cinder-6ef7e652-aaa3-4225-89f4-11d3213ff607-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-6ef7e652-aaa3-4225-89f4-11d3213ff607-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "cinder-quobyte-6ef7e652-aaa3-4225-89f4-11d3213ff607" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-quobyte-6ef7e652-aaa3-4225-89f4-11d3213ff607" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8d8618-2fc2-4794-8abd-e8544de2cf2c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:12:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:50 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 Sep 11 23:12:50 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:51 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607" returned: 0 in 0.475s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:51 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607 Sep 11 23:12:51 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:51 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6ef7e652-aaa3-4225-89f4-11d3213ff607" returned: 0 in 0.337s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-quobyte-6ef7e652-aaa3-4225-89f4-11d3213ff607" released by "delete_volume" :: held 0.904s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Created reservations ['bf36a440-3ff7-49a8-8684-c0fc314970b4', '958ecae8-aea9-45ab-8524-942935c6e060', '31319942-2b8b-44e1-8712-d6ee937bce3a', 'ce1f740a-9671-4e86-bccc-b8e481e05599'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:12:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:12:51 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:12:51 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:12:52 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 11 23:12:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.388s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:12:52 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:12:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Deleted volume successfully. Sep 11 23:12:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-977799f7-f38e-4a79-b915-589bde0b3f09 tempest-VolumesListTestJSON-620578116 None] Lock "cinder-6ef7e652-aaa3-4225-89f4-11d3213ff607-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:01 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=187,cinder:SELECT=164,cinder:DELETE=15,cinder:INSERT=63 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:13:02 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=71,cinder:INSERT=24,cinder:UPDATE=114,cinder:DELETE=6 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (9fb3b9cc-07dd-485d-81c0-02bb3400c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52890d4f-f47a-464a-a187-a5e406523441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52890d4f-f47a-464a-a187-a5e406523441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1619367951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77d37ca-0f7a-4385-aa15-fd2a949fc699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa80abbcf574a60bfe71e069be9d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:10Z,use_quota=True,user_id='bc6e84c456984b39a0228f0fc2ac0524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ed7fe4-c919-439a-a505-9003909861d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ed7fe4-c919-439a-a505-9003909861d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104828ca-4169-439b-9a77-492a2e18cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104828ca-4169-439b-9a77-492a2e18cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77d37ca-0f7a-4385-aa15-fd2a949fc699', 'volume_name': 'volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e14669a-c8b5-4fea-9add-28c0e67609ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e14669a-c8b5-4fea-9add-28c0e67609ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b203c634-e097-47ce-953e-445c953788bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:10 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Volume e77d37ca-0f7a-4385-aa15-fd2a949fc699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699', 'volume_size': 1} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1619367951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77d37ca-0f7a-4385-aa15-fd2a949fc699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa80abbcf574a60bfe71e069be9d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:10Z,use_quota=True,user_id='bc6e84c456984b39a0228f0fc2ac0524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Creating volume e77d37ca-0f7a-4385-aa15-fd2a949fc699 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:10 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:13:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:10 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 1073741824 Sep 11 23:13:10 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:11 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 1073741824" returned: 0 in 0.508s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:11 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 Sep 11 23:13:11 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:11 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699" returned: 0 in 0.314s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:11 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:13:11 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b203c634-e097-47ce-953e-445c953788bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d7ea5f-c2ae-4ca2-918a-8772857a7844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:11 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Volume volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 (e77d37ca-0f7a-4385-aa15-fd2a949fc699): created successfully Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d7ea5f-c2ae-4ca2-918a-8772857a7844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (9fb3b9cc-07dd-485d-81c0-02bb3400c079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:11 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ad460dfc-a752-4681-8416-255639696090 tempest-VolumesSnapshotTestJSON-801198714 None] Created volume successfully. Sep 11 23:13:11 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.295s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:13:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:13:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Creating offline snapshot 80fae5d6-7468-4e86-8ccb-0db2b4cc93be of volume e77d37ca-0f7a-4385-aa15-fd2a949fc699 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:13:13 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1fd577-7a5b-4146-a824-c54fd98a1b6a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:13 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 Sep 11 23:13:13 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:13 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699" returned: 0 in 0.415s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:13 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be 1G Sep 11 23:13:13 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:14 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be 1G" returned: 0 in 0.482s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:14 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be Sep 11 23:13:14 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Flow 'volume_create_manager' (72c999bd-c9c6-451d-b2c8-3a831242ac92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70200ef2-72e4-40ed-83c5-27d5d43ac411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:14 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70200ef2-72e4-40ed-83c5-27d5d43ac411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-245274142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45159ed2-6c09-4668-9027-95ae351ff29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd0918555ae4845a12c5f1ce65b7b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:14Z,use_quota=True,user_id='30367df478c342d3bbff1c3f7b6a9bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2650a592-438a-4199-836f-a2615d902981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2650a592-438a-4199-836f-a2615d902981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c382a47-bff7-4d0f-ae8b-42f070236eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c382a47-bff7-4d0f-ae8b-42f070236eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45159ed2-6c09-4668-9027-95ae351ff29c', 'volume_name': 'volume-45159ed2-6c09-4668-9027-95ae351ff29c', 'volume_size': 2}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8991a803-3ede-48e1-be4a-e33670e0dbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8991a803-3ede-48e1-be4a-e33670e0dbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5997ef79-10fc-42c0-99f5-4fc768192402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:14 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Volume 45159ed2-6c09-4668-9027-95ae351ff29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45159ed2-6c09-4668-9027-95ae351ff29c', 'volume_size': 2} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be" returned: 0 in 0.472s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:14 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be is being set with open permissions: ugo+rw Sep 11 23:13:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:14 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be Sep 11 23:13:14 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:15 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be" returned: 0 in 0.369s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:15 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.info Sep 11 23:13:15 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:15 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-d1147848-638f-4afd-a774-090becf67138 req-6e332ded-d986-4483-9ba2-973fadee26dd tempest-TestShelveInstance-919859006 None] Terminate volume connection completed successfully. Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-d1147848-638f-4afd-a774-090becf67138 req-6e332ded-d986-4483-9ba2-973fadee26dd tempest-TestShelveInstance-919859006 None] Deleting attachment 5c32c167-c98f-4ea2-ab74-474135a07275. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:13:15 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.info" returned: 0 in 0.285s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:15 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.info is being set with open permissions: ugo+rw Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:15 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.info Sep 11 23:13:15 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:15 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.info" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-245274142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45159ed2-6c09-4668-9027-95ae351ff29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd0918555ae4845a12c5f1ce65b7b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:14Z,use_quota=True,user_id='30367df478c342d3bbff1c3f7b6a9bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Creating volume 45159ed2-6c09-4668-9027-95ae351ff29c {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:15 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:13:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c 2147483648 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:15 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c 2147483648 Sep 11 23:13:15 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:15 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-edaac150-72a8-4fb8-9d02-bbe9ffa3072c tempest-VolumesSnapshotTestJSON-801198714 None] Create snapshot completed successfully Sep 11 23:13:16 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c 2147483648" returned: 0 in 0.547s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:16 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c Sep 11 23:13:16 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:16 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-80fae5d6-7468-4e86-8ccb-0db2b4cc93be-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-80fae5d6-7468-4e86-8ccb-0db2b4cc93be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5997ef79-10fc-42c0-99f5-4fc768192402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45159ed2-6c09-4668-9027-95ae351ff29c', 'volume_size': 2}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77784108-ab70-482c-be3b-78dba2ce5c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:16 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Volume volume-45159ed2-6c09-4668-9027-95ae351ff29c (45159ed2-6c09-4668-9027-95ae351ff29c): created successfully Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77784108-ab70-482c-be3b-78dba2ce5c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Flow 'volume_create_manager' (72c999bd-c9c6-451d-b2c8-3a831242ac92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-44c3240e-78ff-4b5e-86b4-21906540b06f tempest-VolumesCloneNegativeTest-1919798921 None] Created volume successfully. Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-e77d37ca-0f7a-4385-aa15-fd2a949fc699" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-e77d37ca-0f7a-4385-aa15-fd2a949fc699" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-80fae5d6-7468-4e86-8ccb-0db2b4cc93be" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-80fae5d6-7468-4e86-8ccb-0db2b4cc93be" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Deleting offline snapshot 80fae5d6-7468-4e86-8ccb-0db2b4cc93be of volume e77d37ca-0f7a-4385-aa15-fd2a949fc699 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] snapshot_file for this snap is: volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2420f8bb-6316-450e-a705-a4ce63e49a9a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:16 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be Sep 11 23:13:16 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:17 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be" returned: 0 in 0.381s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00dc3ff-7de7-48ee-ad92-07122f94baf1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:17 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 Sep 11 23:13:17 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-af37c96e-a799-4d57-a9e5-7188be255528 req-9acb22fd-25b6-4abe-a99c-7d759237fcb3 tempest-TestShelveInstance-919859006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-af37c96e-a799-4d57-a9e5-7188be255528 req-9acb22fd-25b6-4abe-a99c-7d759237fcb3 tempest-TestShelveInstance-919859006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-af37c96e-a799-4d57-a9e5-7188be255528 req-9acb22fd-25b6-4abe-a99c-7d759237fcb3 tempest-TestShelveInstance-919859006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-af37c96e-a799-4d57-a9e5-7188be255528 req-9acb22fd-25b6-4abe-a99c-7d759237fcb3 tempest-TestShelveInstance-919859006 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-756ae783-558a-4a18-bb9b-dc3720ec2592', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35ac4265-fa29-41f4-96e2-f4a65445d5c5', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:13:17 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-af37c96e-a799-4d57-a9e5-7188be255528 req-9acb22fd-25b6-4abe-a99c-7d759237fcb3 tempest-TestShelveInstance-919859006 None] attachment_update completed successfully. Sep 11 23:13:17 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699" returned: 0 in 0.404s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:17 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be Sep 11 23:13:17 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Acquiring lock "cinder-45159ed2-6c09-4668-9027-95ae351ff29c-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "cinder-45159ed2-6c09-4668-9027-95ae351ff29c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Acquiring lock "cinder-quobyte-45159ed2-6c09-4668-9027-95ae351ff29c" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "cinder-quobyte-45159ed2-6c09-4668-9027-95ae351ff29c" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3df411-6694-4e6e-9edd-991f4ea91abb]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:18 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:18 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be Sep 11 23:13:18 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:18 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c Sep 11 23:13:18 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:18 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699.80fae5d6-7468-4e86-8ccb-0db2b4cc93be" returned: 0 in 0.283s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-80fae5d6-7468-4e86-8ccb-0db2b4cc93be" released by "_delete_snapshot" :: held 1.631s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-e77d37ca-0f7a-4385-aa15-fd2a949fc699" released by "delete_snapshot" :: held 1.658s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:18 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c" returned: 0 in 0.411s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:18 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c Sep 11 23:13:18 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Created reservations ['b93242f5-ad98-41f1-9351-3403dd3bb113', '36e29c42-bc19-4bcb-94e8-bad8e01162da', '00045004-2090-424b-9b91-f04609df8887', '5a6e321a-45d3-40ec-9dd5-f0bf8ec83586'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Delete snapshot completed successfully. Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f4ab5770-c077-4fbf-b907-d339ce3c1dcf tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-80fae5d6-7468-4e86-8ccb-0db2b4cc93be-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:18 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-45159ed2-6c09-4668-9027-95ae351ff29c" returned: 0 in 0.354s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "cinder-quobyte-45159ed2-6c09-4668-9027-95ae351ff29c" released by "delete_volume" :: held 0.812s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Created reservations ['664f9895-1a0d-4560-b5fa-ef88072440a0', '30603c79-b3a9-4120-88be-95fcf20cfde8', 'e0d32492-a8b4-4499-986b-6101a8a83118', 'fd54999b-2814-44cd-a08b-5c1e05e62ba8'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:18 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:13:18 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:19 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.376s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:19 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Deleted volume successfully. Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d63a3281-382b-4fee-8678-61e040107e8f tempest-VolumesCloneNegativeTest-1919798921 None] Lock "cinder-45159ed2-6c09-4668-9027-95ae351ff29c-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (f4aae395-d189-4b65-8b82-90efe7b53b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de915373-7606-4cbe-965a-d8babc3a84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de915373-7606-4cbe-965a-d8babc3a84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-807081375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d7d246-af17-4cb1-ae2a-b315481047dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa80abbcf574a60bfe71e069be9d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:19Z,use_quota=True,user_id='bc6e84c456984b39a0228f0fc2ac0524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6504853a-8bb6-423b-a557-f5abdd01176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6504853a-8bb6-423b-a557-f5abdd01176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb85d0e-62ed-41a9-83cd-cdfaf349c656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb85d0e-62ed-41a9-83cd-cdfaf349c656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d7d246-af17-4cb1-ae2a-b315481047dd', 'volume_name': 'volume-b9d7d246-af17-4cb1-ae2a-b315481047dd', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20b4f82-ab57-452f-bdf1-cd956c21a454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20b4f82-ab57-452f-bdf1-cd956c21a454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2ee647-8193-4109-856d-71720247f4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:19 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Volume b9d7d246-af17-4cb1-ae2a-b315481047dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d7d246-af17-4cb1-ae2a-b315481047dd', 'volume_size': 1} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-807081375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d7d246-af17-4cb1-ae2a-b315481047dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa80abbcf574a60bfe71e069be9d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:19Z,use_quota=True,user_id='bc6e84c456984b39a0228f0fc2ac0524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Creating volume b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:19 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:13:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:19 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd 1073741824 Sep 11 23:13:19 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:20 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd 1073741824" returned: 0 in 0.568s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:20 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd Sep 11 23:13:20 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:20 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd" returned: 0 in 0.463s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2ee647-8193-4109-856d-71720247f4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d7d246-af17-4cb1-ae2a-b315481047dd', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979f32e9-01d1-424e-8816-a564b8544515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:20 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Volume volume-b9d7d246-af17-4cb1-ae2a-b315481047dd (b9d7d246-af17-4cb1-ae2a-b315481047dd): created successfully Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979f32e9-01d1-424e-8816-a564b8544515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (f4aae395-d189-4b65-8b82-90efe7b53b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-eb9fc81d-0602-42bc-b897-c8dcb7ba94e3 tempest-VolumesSnapshotTestJSON-801198714 None] Created volume successfully. Sep 11 23:13:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Creating offline snapshot 8a783fdc-1135-44a9-a6af-ab51c6ea1824 of volume b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:13:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e03e29-22a9-484e-8d06-b0e95cb8cb97]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:22 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd Sep 11 23:13:22 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:22 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd" returned: 0 in 0.478s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:22 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 1G Sep 11 23:13:22 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:23 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 1G" returned: 0 in 0.601s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d7d246-af17-4cb1-ae2a-b315481047dd -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:23 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d7d246-af17-4cb1-ae2a-b315481047dd -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 Sep 11 23:13:23 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:23 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d7d246-af17-4cb1-ae2a-b315481047dd -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824" returned: 0 in 0.345s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:23 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 is being set with open permissions: ugo+rw Sep 11 23:13:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:23 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 Sep 11 23:13:23 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:23 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824" returned: 0 in 0.290s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:23 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.info Sep 11 23:13:23 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:24 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.info" returned: 0 in 0.291s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:24 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.info is being set with open permissions: ugo+rw Sep 11 23:13:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:24 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.info Sep 11 23:13:24 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:24 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.info" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e8cf3607-b79e-4df5-8fe3-60ce6226f3c6 tempest-VolumesSnapshotTestJSON-801198714 None] Create snapshot completed successfully Sep 11 23:13:25 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (0dfa2590-2b3b-42da-9774-ee7d78031d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1b8365-775c-44e8-adfb-95342c8ba322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1b8365-775c-44e8-adfb-95342c8ba322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-966515002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060096a1-c0e9-43aa-80a1-18a99c11e238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa80abbcf574a60bfe71e069be9d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8a783fdc-1135-44a9-a6af-ab51c6ea1824,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:26Z,use_quota=True,user_id='bc6e84c456984b39a0228f0fc2ac0524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3c5c61-1244-4f21-a6bb-17d0a2f298a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3c5c61-1244-4f21-a6bb-17d0a2f298a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796800cc-09a7-4e2f-8112-dabbc6bee240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796800cc-09a7-4e2f-8112-dabbc6bee240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '060096a1-c0e9-43aa-80a1-18a99c11e238', 'volume_name': 'volume-060096a1-c0e9-43aa-80a1-18a99c11e238', 'volume_size': 2, 'snapshot_id': '8a783fdc-1135-44a9-a6af-ab51c6ea1824'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adb8ba1-2edb-4273-9bac-3d439ee13bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adb8ba1-2edb-4273-9bac-3d439ee13bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36bdd16-3372-4e9a-97f2-1c25f6d36c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:26 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Volume 060096a1-c0e9-43aa-80a1-18a99c11e238: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-060096a1-c0e9-43aa-80a1-18a99c11e238', 'volume_size': 2, 'snapshot_id': '8a783fdc-1135-44a9-a6af-ab51c6ea1824'} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-8a783fdc-1135-44a9-a6af-ab51c6ea1824-060096a1-c0e9-43aa-80a1-18a99c11e238" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-8a783fdc-1135-44a9-a6af-ab51c6ea1824-060096a1-c0e9-43aa-80a1-18a99c11e238" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Creating volume 060096a1-c0e9-43aa-80a1-18a99c11e238 from snapshot 8a783fdc-1135-44a9-a6af-ab51c6ea1824 {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-060096a1-c0e9-43aa-80a1-18a99c11e238" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-060096a1-c0e9-43aa-80a1-18a99c11e238" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] snapshot: 8a783fdc-1135-44a9-a6af-ab51c6ea1824, volume: 060096a1-c0e9-43aa-80a1-18a99c11e238, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7e5b87-e9be-46dc-a28c-cba8c2bd9795]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:26 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 Sep 11 23:13:26 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:26 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824" returned: 0 in 0.453s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9d7d246-af17-4cb1-ae2a-b315481047dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[768c2089-c43b-4120-a445-12ea74dab878]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:26 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd Sep 11 23:13:26 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:27 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:13:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:13:27 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:13:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:27 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 Sep 11 23:13:27 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:34 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238" returned: 0 in 7.242s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:13:34 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Converted 1024.00 MB image at 141.35 MB/s Sep 11 23:13:34 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 is being set with open permissions: ugo+rw Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:34 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 Sep 11 23:13:34 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:34 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-060096a1-c0e9-43aa-80a1-18a99c11e238" released by "_copy_volume_from_snapshot" :: held 8.528s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-8a783fdc-1135-44a9-a6af-ab51c6ea1824-060096a1-c0e9-43aa-80a1-18a99c11e238" released by "_create_volume_from_snapshot" :: held 8.635s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.656s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36bdd16-3372-4e9a-97f2-1c25f6d36c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060096a1-c0e9-43aa-80a1-18a99c11e238', 'volume_size': 2, 'snapshot_id': '8a783fdc-1135-44a9-a6af-ab51c6ea1824'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00f5566-ea50-4d8c-a869-54c1196d681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Volume volume-060096a1-c0e9-43aa-80a1-18a99c11e238 (060096a1-c0e9-43aa-80a1-18a99c11e238): created successfully Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00f5566-ea50-4d8c-a869-54c1196d681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (0dfa2590-2b3b-42da-9774-ee7d78031d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5b770e2f-698d-4d4e-9a23-3c8194e52269 tempest-VolumesSnapshotTestJSON-801198714 None] Created volume successfully. Sep 11 23:13:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-060096a1-c0e9-43aa-80a1-18a99c11e238-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-060096a1-c0e9-43aa-80a1-18a99c11e238-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-060096a1-c0e9-43aa-80a1-18a99c11e238" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-060096a1-c0e9-43aa-80a1-18a99c11e238" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b121602-3a11-4d4d-baf9-0f4500be6baf]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:35 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 Sep 11 23:13:35 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:36 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238" returned: 0 in 0.572s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:36 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238 Sep 11 23:13:36 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:36 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-060096a1-c0e9-43aa-80a1-18a99c11e238" returned: 0 in 0.316s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-060096a1-c0e9-43aa-80a1-18a99c11e238" released by "delete_volume" :: held 0.949s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Created reservations ['e79aea36-55e2-4dcc-8883-de456b5ecb8e', '2802159d-6172-4055-9489-f92f758f564e', '3ba679c9-66c9-4a65-b2ee-8ad7a0104e25', '6caaa210-5fbf-4826-a220-ae7a1cfd2096'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:36 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:13:36 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:37 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:37 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Deleted volume successfully. Sep 11 23:13:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cbe1d6de-5d63-4ffc-9892-28c90ff99868 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-060096a1-c0e9-43aa-80a1-18a99c11e238-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-8a783fdc-1135-44a9-a6af-ab51c6ea1824-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-8a783fdc-1135-44a9-a6af-ab51c6ea1824-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-b9d7d246-af17-4cb1-ae2a-b315481047dd" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-b9d7d246-af17-4cb1-ae2a-b315481047dd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-8a783fdc-1135-44a9-a6af-ab51c6ea1824" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-8a783fdc-1135-44a9-a6af-ab51c6ea1824" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Deleting offline snapshot 8a783fdc-1135-44a9-a6af-ab51c6ea1824 of volume b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] snapshot_file for this snap is: volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce5f8b-af2b-4f80-9b44-023cac66dd60]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:38 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 Sep 11 23:13:38 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:38 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824" returned: 0 in 0.468s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9d7d246-af17-4cb1-ae2a-b315481047dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d708a6d6-7b74-4577-80c6-30e4d93652a2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:38 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd Sep 11 23:13:38 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:39 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd" returned: 0 in 0.739s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:39 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 Sep 11 23:13:39 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:39 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824" returned: 0 in 0.401s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:39 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824 Sep 11 23:13:39 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:39 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd.8a783fdc-1135-44a9-a6af-ab51c6ea1824" returned: 0 in 0.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-8a783fdc-1135-44a9-a6af-ab51c6ea1824" released by "_delete_snapshot" :: held 1.991s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-b9d7d246-af17-4cb1-ae2a-b315481047dd" released by "delete_snapshot" :: held 2.021s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:40 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Created reservations ['a366c6b6-4121-4bea-b629-a5ebc86aeb2e', '6c5ed402-8dfe-4146-be79-e12a9f3709cb', '35689ed6-7636-4b93-bd66-7ae9bf2e4356', 'f237c1a3-d69d-4bab-adfd-355c54eea110'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Delete snapshot completed successfully. Sep 11 23:13:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f42ed58e-8591-4f71-86cd-d71ca6bb82e9 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-8a783fdc-1135-44a9-a6af-ab51c6ea1824-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-b9d7d246-af17-4cb1-ae2a-b315481047dd-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-b9d7d246-af17-4cb1-ae2a-b315481047dd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-b9d7d246-af17-4cb1-ae2a-b315481047dd" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-b9d7d246-af17-4cb1-ae2a-b315481047dd" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:41 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e87923-2f74-4edf-a5e6-114448a95a3c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:41 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd Sep 11 23:13:41 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:41 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd" returned: 0 in 0.411s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:41 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd Sep 11 23:13:41 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:42 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-b9d7d246-af17-4cb1-ae2a-b315481047dd" returned: 0 in 0.287s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-b9d7d246-af17-4cb1-ae2a-b315481047dd" released by "delete_volume" :: held 0.752s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Created reservations ['bb3341ec-6cb3-456d-99d7-0fe007da7a38', '87a745ef-4fc6-4b14-bbc1-0072cb4c6bb7', 'd8a293a7-fe78-46a6-8772-52a015a09306', '9550541e-5212-4b3c-bfa2-7b7b95a9412e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:42 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:13:42 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:42 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.292s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Deleted volume successfully. Sep 11 23:13:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-035916ce-a38b-4fbe-a8f7-5259a20be453 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-b9d7d246-af17-4cb1-ae2a-b315481047dd-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (0c82804e-64d5-4b93-80d8-5f894636330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecb0515-a051-43ee-934c-508b2add7e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecb0515-a051-43ee-934c-508b2add7e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-930436941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d533e287-8182-46c6-b576-142229c01975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa80abbcf574a60bfe71e069be9d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:43Z,use_quota=True,user_id='bc6e84c456984b39a0228f0fc2ac0524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e79014-bae8-4fec-b7c5-f163db9ecf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e79014-bae8-4fec-b7c5-f163db9ecf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28030609-d5a0-4523-988c-a583c9c9711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28030609-d5a0-4523-988c-a583c9c9711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd533e287-8182-46c6-b576-142229c01975', 'volume_name': 'volume-d533e287-8182-46c6-b576-142229c01975', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a89f18e-de67-48e6-9163-62a49abf1fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a89f18e-de67-48e6-9163-62a49abf1fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221a66cb-02c7-4fbb-ae86-64f491ae0041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Volume d533e287-8182-46c6-b576-142229c01975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d533e287-8182-46c6-b576-142229c01975', 'volume_size': 1} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-930436941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d533e287-8182-46c6-b576-142229c01975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa80abbcf574a60bfe71e069be9d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:43Z,use_quota=True,user_id='bc6e84c456984b39a0228f0fc2ac0524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Creating volume d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:43 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:43 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 1073741824 Sep 11 23:13:43 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:43 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 1073741824" returned: 0 in 0.473s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:43 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 Sep 11 23:13:43 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:44 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975" returned: 0 in 0.320s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221a66cb-02c7-4fbb-ae86-64f491ae0041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d533e287-8182-46c6-b576-142229c01975', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1bc931-21ac-4b37-aa6d-bd706c510286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Volume volume-d533e287-8182-46c6-b576-142229c01975 (d533e287-8182-46c6-b576-142229c01975): created successfully Sep 11 23:13:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1bc931-21ac-4b37-aa6d-bd706c510286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (0c82804e-64d5-4b93-80d8-5f894636330b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7777066b-eba0-4740-9925-df038994edc5 tempest-VolumesSnapshotTestJSON-801198714 None] Created volume successfully. Sep 11 23:13:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Creating offline snapshot 811656b8-f54c-4e9a-8252-19f203950d29 of volume d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:13:45 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e01d459-3607-47a0-ab50-68a42e1552be]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:45 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 Sep 11 23:13:45 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:45 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975" returned: 0 in 0.433s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:45 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 1G Sep 11 23:13:45 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:46 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 1G" returned: 0 in 0.555s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d533e287-8182-46c6-b576-142229c01975 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:46 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d533e287-8182-46c6-b576-142229c01975 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 Sep 11 23:13:46 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:46 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d533e287-8182-46c6-b576-142229c01975 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29" returned: 0 in 0.377s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:46 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 is being set with open permissions: ugo+rw Sep 11 23:13:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:46 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 Sep 11 23:13:46 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:47 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29" returned: 0 in 0.275s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:47 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.info Sep 11 23:13:47 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:47 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.info" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:47 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.info is being set with open permissions: ugo+rw Sep 11 23:13:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:47 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.info Sep 11 23:13:47 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:47 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.info" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d67df949-17bc-4d76-9485-298eea3da741 tempest-VolumesSnapshotTestJSON-801198714 None] Create snapshot completed successfully Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (195440e2-01b8-4089-988d-68eb3b1a4d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f3169b-1fd7-453a-8a99-b7148309bb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f3169b-1fd7-453a-8a99-b7148309bb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-363085382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa80abbcf574a60bfe71e069be9d9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=811656b8-f54c-4e9a-8252-19f203950d29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:49Z,use_quota=True,user_id='bc6e84c456984b39a0228f0fc2ac0524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce99ac46-8e39-40f6-90fc-1feae98de368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce99ac46-8e39-40f6-90fc-1feae98de368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60b60c5-f7c0-460a-ba28-cf034788c995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60b60c5-f7c0-460a-ba28-cf034788c995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5', 'volume_name': 'volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5', 'volume_size': 1, 'snapshot_id': '811656b8-f54c-4e9a-8252-19f203950d29'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711df4ba-5e20-48ab-bf01-af18c9490ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711df4ba-5e20-48ab-bf01-af18c9490ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a29bb2-ac9d-4f11-85c8-6baa3e57015c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Volume 048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5', 'volume_size': 1, 'snapshot_id': '811656b8-f54c-4e9a-8252-19f203950d29'} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-811656b8-f54c-4e9a-8252-19f203950d29-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-811656b8-f54c-4e9a-8252-19f203950d29-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Creating volume 048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 from snapshot 811656b8-f54c-4e9a-8252-19f203950d29 {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] snapshot: 811656b8-f54c-4e9a-8252-19f203950d29, volume: 048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf731b-6047-4c82-b832-fc16f1fc379f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:49 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 Sep 11 23:13:49 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:49 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29" returned: 0 in 0.448s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d533e287-8182-46c6-b576-142229c01975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9b9a2a-2e30-4f8a-b535-7c916df181a1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:50 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 Sep 11 23:13:50 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:50 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975" returned: 0 in 0.399s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:13:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:13:50 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:13:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:50 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 Sep 11 23:13:50 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:13:55 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Flow 'volume_create_manager' (1f5778c8-b2f5-4bd6-a361-7c04da12ef05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3535215c-d935-4f41-8b26-94d338e62eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" returned: 0 in 5.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:13:55 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Converted 1024.00 MB image at 194.41 MB/s Sep 11 23:13:55 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 is being set with open permissions: ugo+rw Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3535215c-d935-4f41-8b26-94d338e62eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-27767468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd30796-2e28-4516-9d2f-046e6bceeded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6948f6db6746a7bf101cb6c99f8d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:55Z,use_quota=True,user_id='49715f060f8945ca8d5d09a38b322098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:55 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 Sep 11 23:13:55 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00cf906-7553-4546-b1c3-18408f07c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00cf906-7553-4546-b1c3-18408f07c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b396047-b231-4bd7-adf6-51df091ca572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b396047-b231-4bd7-adf6-51df091ca572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd30796-2e28-4516-9d2f-046e6bceeded', 'volume_name': 'volume-3cd30796-2e28-4516-9d2f-046e6bceeded', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8149448a-1ec3-4159-a7da-f7e0301da541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8149448a-1ec3-4159-a7da-f7e0301da541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daca4dba-940a-4673-8f45-89bd9c8287cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:55 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Volume 3cd30796-2e28-4516-9d2f-046e6bceeded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd30796-2e28-4516-9d2f-046e6bceeded', 'volume_size': 1} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:55 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" returned: 0 in 0.284s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" released by "_copy_volume_from_snapshot" :: held 6.508s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-811656b8-f54c-4e9a-8252-19f203950d29-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" released by "_create_volume_from_snapshot" :: held 6.581s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.606s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.275s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-27767468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd30796-2e28-4516-9d2f-046e6bceeded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6948f6db6746a7bf101cb6c99f8d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:55Z,use_quota=True,user_id='49715f060f8945ca8d5d09a38b322098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Creating volume 3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:13:55 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:13:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:56 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded 1073741824 Sep 11 23:13:56 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a29bb2-ac9d-4f11-85c8-6baa3e57015c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5', 'volume_size': 1, 'snapshot_id': '811656b8-f54c-4e9a-8252-19f203950d29'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a16546f-9366-464c-9c98-659914330e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:56 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Volume volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 (048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5): created successfully Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a16546f-9366-464c-9c98-659914330e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Flow 'volume_create_manager' (195440e2-01b8-4089-988d-68eb3b1a4d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f0dbfbb8-bc8b-4182-a183-6d12f61ebe10 tempest-VolumesSnapshotTestJSON-801198714 None] Created volume successfully. Sep 11 23:13:56 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded 1073741824" returned: 0 in 0.528s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:56 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded Sep 11 23:13:56 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:56 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daca4dba-940a-4673-8f45-89bd9c8287cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd30796-2e28-4516-9d2f-046e6bceeded', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4995f6be-c8ba-4dbf-97f3-4840331b5a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:13:56 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Volume volume-3cd30796-2e28-4516-9d2f-046e6bceeded (3cd30796-2e28-4516-9d2f-046e6bceeded): created successfully Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4995f6be-c8ba-4dbf-97f3-4840331b5a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:13:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Flow 'volume_create_manager' (1f5778c8-b2f5-4bd6-a361-7c04da12ef05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:13:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4c40a8e2-69a1-4c5d-aa93-d0737051738c tempest-TestStampPattern-1316296137 None] Created volume successfully. Sep 11 23:13:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:57 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9487ca0-d981-45bf-be2a-af221fa7022e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:57 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 Sep 11 23:13:57 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:57 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" returned: 0 in 0.448s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:57 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5 Sep 11 23:13:57 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:58 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" returned: 0 in 0.334s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5" released by "delete_volume" :: held 0.833s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Created reservations ['1d3d3b16-ec21-45c0-a075-f8ee2c38b372', '5fa81cb4-12e5-4af2-b669-a487358918ad', '9aba6404-567c-498d-aa08-10ddaec58d3e', '634cd7ea-8766-40e6-9997-93cdfacd7656'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:58 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:13:58 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-811656b8-f54c-4e9a-8252-19f203950d29-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-811656b8-f54c-4e9a-8252-19f203950d29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-d533e287-8182-46c6-b576-142229c01975" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-d533e287-8182-46c6-b576-142229c01975" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-811656b8-f54c-4e9a-8252-19f203950d29" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-811656b8-f54c-4e9a-8252-19f203950d29" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Deleting offline snapshot 811656b8-f54c-4e9a-8252-19f203950d29 of volume d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:13:58 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] snapshot_file for this snap is: volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.395s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:13:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Deleted volume successfully. Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4713088-81ad-43ee-bff8-3720f39344fd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-72c15877-6c57-4304-9227-052c7194be88 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-048575b4-1fb8-4ac8-bee7-3beb1a4f1cc5-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:13:58 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 Sep 11 23:13:58 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:59 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29" returned: 0 in 0.594s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d533e287-8182-46c6-b576-142229c01975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:13:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f467ee-c814-4894-9bff-69c653ef3bda]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:13:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:59 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 Sep 11 23:13:59 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:13:59 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 11 23:13:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975" returned: 0 in 0.662s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:13:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:13:59 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 Sep 11 23:13:59 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:00 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29" returned: 0 in 0.522s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:00 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29 Sep 11 23:14:00 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:00 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975.811656b8-f54c-4e9a-8252-19f203950d29" returned: 0 in 0.350s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-811656b8-f54c-4e9a-8252-19f203950d29" released by "_delete_snapshot" :: held 2.316s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-d533e287-8182-46c6-b576-142229c01975" released by "delete_snapshot" :: held 2.355s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:00 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Created reservations ['c0393566-b7de-49c5-9d0c-5cf4bb9c7c7d', '578e54b9-f3ec-46b8-8639-44dbd9489d2c', '06b666a3-ff0e-476f-bbd6-f8edef8e264f', '11a9f5bf-f987-4a4c-8768-0df898eea4b7'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Delete snapshot completed successfully. Sep 11 23:14:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-18bda774-acf6-4b6d-bdcd-81f5644dafce tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-811656b8-f54c-4e9a-8252-19f203950d29-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-d533e287-8182-46c6-b576-142229c01975-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-d533e287-8182-46c6-b576-142229c01975-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:01 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=80,cinder:UPDATE=81,cinder:INSERT=20,cinder:DELETE=6 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:14:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-d533e287-8182-46c6-b576-142229c01975" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-d533e287-8182-46c6-b576-142229c01975" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c96897-5ba3-4a78-baa1-3ce003b45ca7]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:02 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 Sep 11 23:14:02 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:02 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975" returned: 0 in 0.660s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:02 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975 Sep 11 23:14:02 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:03 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d533e287-8182-46c6-b576-142229c01975" returned: 0 in 0.649s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-d533e287-8182-46c6-b576-142229c01975" released by "delete_volume" :: held 1.459s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=79,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=8 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Created reservations ['1b8bc52c-ac61-4149-9d87-3f40220e3667', '1985a837-bfd8-464c-8b47-c0d3b76ff7e8', '127472dc-94be-4b76-9c6d-956d72107968', 'ec4f1e15-f0c6-4664-a8c5-4d681a0547ce'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:03 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:14:03 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-eca47d19-7854-4b88-8434-b26a259440ce tempest-TestShelveInstance-919859006 None] Terminate volume connection completed successfully. Sep 11 23:14:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-eca47d19-7854-4b88-8434-b26a259440ce tempest-TestShelveInstance-919859006 None] Deleting attachment 35ac4265-fa29-41f4-96e2-f4a65445d5c5. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Acquiring lock "cinder-756ae783-558a-4a18-bb9b-dc3720ec2592-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Lock "cinder-756ae783-558a-4a18-bb9b-dc3720ec2592-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Acquiring lock "cinder-quobyte-756ae783-558a-4a18-bb9b-dc3720ec2592" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Lock "cinder-quobyte-756ae783-558a-4a18-bb9b-dc3720ec2592" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a21b75-7ecf-408d-85d7-902dfec3c837]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:04 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.470s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Deleted volume successfully. Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65c937ae-3a27-4224-86fb-881b45a0bb8c tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-d533e287-8182-46c6-b576-142229c01975-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:04 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 Sep 11 23:14:04 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-e77d37ca-0f7a-4385-aa15-fd2a949fc699-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-e77d37ca-0f7a-4385-aa15-fd2a949fc699-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "cinder-quobyte-e77d37ca-0f7a-4385-aa15-fd2a949fc699" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-e77d37ca-0f7a-4385-aa15-fd2a949fc699" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4adc4a9-b660-4767-88af-c93e9c05bc13]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:04 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 Sep 11 23:14:04 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:04 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592" returned: 0 in 0.712s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:05 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592 Sep 11 23:14:05 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:05 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-756ae783-558a-4a18-bb9b-dc3720ec2592" returned: 0 in 0.254s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:05 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Lock "cinder-quobyte-756ae783-558a-4a18-bb9b-dc3720ec2592" released by "delete_volume" :: held 1.048s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699" returned: 0 in 0.424s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:05 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699 Sep 11 23:14:05 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG cinder.quota [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Created reservations ['b1541705-37a8-46d3-ac70-2ab309a2bf78', 'a9cd45ed-9b1d-44a0-96ea-3193b3ab47bf', '53fe70f2-eef1-4093-a15f-3cbddcf97dc9', 'c2176309-ed5c-4fc3-9c7b-a77eb0c49afe'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:05 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:14:05 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:05 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e77d37ca-0f7a-4385-aa15-fd2a949fc699" returned: 0 in 0.438s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-quobyte-e77d37ca-0f7a-4385-aa15-fd2a949fc699" released by "delete_volume" :: held 0.959s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:05 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Created reservations ['8a82bfc9-687b-4604-bedc-711e25ab1939', '89b407fc-193b-48b7-bb80-b0a714990c1a', '82841abc-c6cc-453b-85bd-920e3c7632ad', 'fd8e574b-00df-42e6-860d-9e363ac4bdd1'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:14:06 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.480s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG cinder.manager [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Deleted volume successfully. Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [req-bc97c8f0-4533-4019-a4c4-f69366fecbac req-c67568f9-b373-4971-a11d-4b593c9b4b97 tempest-TestShelveInstance-919859006 None] Lock "cinder-756ae783-558a-4a18-bb9b-dc3720ec2592-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:06 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:14:06 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:06 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Deleted volume successfully. Sep 11 23:14:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-62be5144-2215-4076-ab83-8b2b02d96266 tempest-VolumesSnapshotTestJSON-801198714 None] Lock "cinder-e77d37ca-0f7a-4385-aa15-fd2a949fc699-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:11 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:14:11 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:11 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.378s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:14:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:14:16 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:14:16 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:INSERT=5,cinder:UPDATE=23,cinder:SELECT=14,cinder:DELETE=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:14:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-a320f43a-a116-461f-a4c7-8b45ae9faecb req-976b9dd5-94cb-4ea4-aedc-3bd02e15839e tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-a320f43a-a116-461f-a4c7-8b45ae9faecb req-976b9dd5-94cb-4ea4-aedc-3bd02e15839e tempest-TestStampPattern-1316296137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-a320f43a-a116-461f-a4c7-8b45ae9faecb req-976b9dd5-94cb-4ea4-aedc-3bd02e15839e tempest-TestStampPattern-1316296137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-a320f43a-a116-461f-a4c7-8b45ae9faecb req-976b9dd5-94cb-4ea4-aedc-3bd02e15839e tempest-TestStampPattern-1316296137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-3cd30796-2e28-4516-9d2f-046e6bceeded', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '793e11dd-1ee7-4325-84ec-0405f66c3cb0', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:14:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-a320f43a-a116-461f-a4c7-8b45ae9faecb req-976b9dd5-94cb-4ea4-aedc-3bd02e15839e tempest-TestStampPattern-1316296137 None] attachment_update completed successfully. Sep 11 23:14:35 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-4a079757-5218-45a2-8608-2af81f652dff req-35ccf72d-5c4b-4389-ba88-dc316a045db6 tempest-TestStampPattern-1316296137 None] Terminate volume connection completed successfully. Sep 11 23:14:35 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-4a079757-5218-45a2-8608-2af81f652dff req-35ccf72d-5c4b-4389-ba88-dc316a045db6 tempest-TestStampPattern-1316296137 None] Deleting attachment 793e11dd-1ee7-4325-84ec-0405f66c3cb0. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:14:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Creating offline snapshot a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 of volume 3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:14:36 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc0746-40bd-4d45-a813-a43fe24dd34c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:37 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded Sep 11 23:14:37 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:37 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded" returned: 0 in 0.419s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:37 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 1G Sep 11 23:14:37 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:37 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 1G" returned: 0 in 0.544s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd30796-2e28-4516-9d2f-046e6bceeded -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:37 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd30796-2e28-4516-9d2f-046e6bceeded -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 Sep 11 23:14:37 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:38 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cd30796-2e28-4516-9d2f-046e6bceeded -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" returned: 0 in 0.372s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:38 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 is being set with open permissions: ugo+rw Sep 11 23:14:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:38 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 Sep 11 23:14:38 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:38 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" returned: 0 in 0.322s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:38 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.info Sep 11 23:14:38 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:38 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.info" returned: 0 in 0.320s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:39 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.info is being set with open permissions: ugo+rw Sep 11 23:14:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:39 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.info Sep 11 23:14:39 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:39 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.info" returned: 0 in 0.417s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:39 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-97997f25-cdcc-4bc3-a854-e36e3cea4b5c tempest-TestStampPattern-1316296137 None] Create snapshot completed successfully Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Flow 'volume_create_manager' (f36ed9e2-0562-4584-8c15-aa2fe6e4061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e81d13-cf05-41b6-b89d-c2bebc3ee522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e81d13-cf05-41b6-b89d-c2bebc3ee522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1740329006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd6948f6db6746a7bf101cb6c99f8d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:48Z,use_quota=True,user_id='49715f060f8945ca8d5d09a38b322098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ba3cef-bb87-49ee-9ff0-0788ab02362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ba3cef-bb87-49ee-9ff0-0788ab02362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabce04c-eb76-42c1-9f99-f79ea7e3d82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabce04c-eb76-42c1-9f99-f79ea7e3d82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1', 'volume_name': 'volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1', 'volume_size': 1, 'snapshot_id': 'a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d497dea-52c6-4ed7-b57f-43a6d6fb549d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d497dea-52c6-4ed7-b57f-43a6d6fb549d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f73294-031c-486b-83b7-822c263f1880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:48 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Volume 4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1', 'volume_size': 1, 'snapshot_id': 'a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15'} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-quobyte-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Creating volume 4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 from snapshot a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-quobyte-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] snapshot: a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15, volume: 4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b6dc52-c710-4f1a-8fb2-2016a20fdd9f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:48 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 Sep 11 23:14:48 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Flow 'volume_create_manager' (e1a94873-7514-46af-8b77-d279da1bcfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f9aaa7-fc6d-4854-9ff5-f94b902f7d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f9aaa7-fc6d-4854-9ff5-f94b902f7d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-631764919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0c724b-2123-4a63-8545-75c877574909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb542f4eba994ee19b07ef7389eb9bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:49Z,use_quota=True,user_id='aa21b1401b8c4a498abe1a0b30d9b403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63993112-ba38-489e-bcb0-1363c3763880),volume_type_id=63993112-ba38-489e-bcb0-1363c3763880)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8691d0ec-48f4-4416-9699-4b5b3255c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8691d0ec-48f4-4416-9699-4b5b3255c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e420b5bd-7aa6-4be7-a73e-d1b9b4f67c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e420b5bd-7aa6-4be7-a73e-d1b9b4f67c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0c724b-2123-4a63-8545-75c877574909', 'volume_name': 'volume-2c0c724b-2123-4a63-8545-75c877574909', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c540b3-6d59-4596-9b94-089c0fdd95ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c540b3-6d59-4596-9b94-089c0fdd95ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536e605d-4158-4526-b2aa-e476a97aab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Volume 2c0c724b-2123-4a63-8545-75c877574909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0c724b-2123-4a63-8545-75c877574909', 'volume_size': 1} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:49 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" returned: 0 in 0.585s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cd30796-2e28-4516-9d2f-046e6bceeded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5eb312-adc6-4610-8307-66661665210f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:49 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded Sep 11 23:14:49 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Flow 'volume_create_manager' (7868af8b-bc83-4a65-810d-c5cc1d9de6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe831bac-295f-4eba-8ac0-57a6bf9c4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe831bac-295f-4eba-8ac0-57a6bf9c4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1014008999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb542f4eba994ee19b07ef7389eb9bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:50Z,use_quota=True,user_id='aa21b1401b8c4a498abe1a0b30d9b403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f342de14-c959-4879-a0b2-27398125695f),volume_type_id=f342de14-c959-4879-a0b2-27398125695f)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82167b3b-a1aa-40ef-8e6f-30e1645080e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82167b3b-a1aa-40ef-8e6f-30e1645080e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0460c39-4fa5-4cd5-ba7d-c2e281f6b297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0460c39-4fa5-4cd5-ba7d-c2e281f6b297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7', 'volume_name': 'volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90bbd44-18ac-4b87-86af-fbc00f8ce0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90bbd44-18ac-4b87-86af-fbc00f8ce0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:49 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1303ab5b-6aa7-4794-92e7-e140a142e7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Volume 6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7', 'volume_size': 1} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded" returned: 0 in 0.667s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:14:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:49 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 Sep 11 23:14:49 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:50 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:14:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Flow 'volume_create_manager' (896ae054-df83-47b1-94e5-f3e152e8de30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1437112-cd1f-4990-bf9c-9ee38c248695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1437112-cd1f-4990-bf9c-9ee38c248695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1412798410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd8c407-3f16-46a0-b0b1-8ee00c229c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb542f4eba994ee19b07ef7389eb9bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:51Z,use_quota=True,user_id='aa21b1401b8c4a498abe1a0b30d9b403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913c2bb5-d395-49d9-8d9c-bd8ab680d95f),volume_type_id=913c2bb5-d395-49d9-8d9c-bd8ab680d95f)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f5de1c-386e-439c-a88a-0d8dc3929705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f5de1c-386e-439c-a88a-0d8dc3929705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55733b4f-4958-493d-9f88-211f009b5e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:51 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:14:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55733b4f-4958-493d-9f88-211f009b5e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fd8c407-3f16-46a0-b0b1-8ee00c229c13', 'volume_name': 'volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13', 'volume_size': 1, 'image_id': '04640a5b-a2f5-4fdb-814b-43b62004d534', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04640a5b-a2f5-4fdb-814b-43b62004d534', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1159438117', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb542f4eba994ee19b07ef7389eb9bc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04640a5b-a2f5-4fdb-814b-43b62004d534', 'created_at': datetime.datetime(2026, 9, 11, 21, 14, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 14, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04640a5b-a2f5-4fdb-814b-43b62004d534/file', 'properties': {}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc4be53-a877-4de0-ae6d-c4328724b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc4be53-a877-4de0-ae6d-c4328724b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4803ff9-ca75-425e-98c0-9d55f85c04df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Volume 3fd8c407-3f16-46a0-b0b1-8ee00c229c13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13', 'volume_size': 1, 'image_id': '04640a5b-a2f5-4fdb-814b-43b62004d534', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04640a5b-a2f5-4fdb-814b-43b62004d534', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1159438117', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb542f4eba994ee19b07ef7389eb9bc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04640a5b-a2f5-4fdb-814b-43b62004d534', 'created_at': datetime.datetime(2026, 9, 11, 21, 14, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 14, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04640a5b-a2f5-4fdb-814b-43b62004d534/file', 'properties': {}}, 'image_service': } Sep 11 23:14:52 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Trying to clone 3fd8c407-3f16-46a0-b0b1-8ee00c229c13 from image 04640a5b-a2f5-4fdb-814b-43b62004d534 at location (None, [{'url': 'file:///opt/stack/data/glance/images/04640a5b-a2f5-4fdb-814b-43b62004d534', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:14:57 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" returned: 0 in 7.553s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:14:57 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Converted 1024.00 MB image at 135.50 MB/s Sep 11 23:14:57 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 is being set with open permissions: ugo+rw Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:57 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 Sep 11 23:14:57 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:57 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" returned: 0 in 0.366s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" released by "_copy_volume_from_snapshot" :: held 9.303s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" released by "_create_volume_from_snapshot" :: held 9.402s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.433s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.763s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-631764919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0c724b-2123-4a63-8545-75c877574909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb542f4eba994ee19b07ef7389eb9bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:49Z,use_quota=True,user_id='aa21b1401b8c4a498abe1a0b30d9b403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63993112-ba38-489e-bcb0-1363c3763880),volume_type_id=63993112-ba38-489e-bcb0-1363c3763880)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Creating volume 2c0c724b-2123-4a63-8545-75c877574909 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:57 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:14:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:57 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 1073741824 Sep 11 23:14:57 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f73294-031c-486b-83b7-822c263f1880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1', 'volume_size': 1, 'snapshot_id': 'a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c21142-6aa8-4513-abfb-2a2de359c6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:58 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Volume volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 (4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1): created successfully Sep 11 23:14:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c21142-6aa8-4513-abfb-2a2de359c6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Flow 'volume_create_manager' (f36ed9e2-0562-4584-8c15-aa2fe6e4061c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cdddf9e4-c180-4d6d-b40c-4bf08429a706 tempest-TestStampPattern-1316296137 None] Created volume successfully. Sep 11 23:14:58 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 1073741824" returned: 0 in 0.778s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:58 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 Sep 11 23:14:58 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:59 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909" returned: 0 in 0.525s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.409s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1014008999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb542f4eba994ee19b07ef7389eb9bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:50Z,use_quota=True,user_id='aa21b1401b8c4a498abe1a0b30d9b403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f342de14-c959-4879-a0b2-27398125695f),volume_type_id=f342de14-c959-4879-a0b2-27398125695f)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Creating volume 6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:14:59 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536e605d-4158-4526-b2aa-e476a97aab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0c724b-2123-4a63-8545-75c877574909', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26467c50-166e-40ab-b874-8ae992cb30c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:14:59 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 1073741824 Sep 11 23:14:59 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:14:59 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Volume volume-2c0c724b-2123-4a63-8545-75c877574909 (2c0c724b-2123-4a63-8545-75c877574909): created successfully Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26467c50-166e-40ab-b874-8ae992cb30c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:14:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Flow 'volume_create_manager' (e1a94873-7514-46af-8b77-d279da1bcfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:14:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3a9566a1-a548-4499-94ee-43e0f859b17e tempest-TestInstancesWithCinderVolumes-338863730 None] Created volume successfully. Sep 11 23:15:00 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 1073741824" returned: 0 in 0.793s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:00 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 Sep 11 23:15:00 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:00 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7" returned: 0 in 0.675s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1303ab5b-6aa7-4794-92e7-e140a142e7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bc8ef8-ef80-4945-b75e-055aad5dca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:00 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Volume volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 (6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7): created successfully Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77bc8ef8-ef80-4945-b75e-055aad5dca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Flow 'volume_create_manager' (7868af8b-bc83-4a65-810d-c5cc1d9de6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-97cdc829-9945-4aff-9085-21f1b5849acc tempest-TestInstancesWithCinderVolumes-338863730 None] Created volume successfully. Sep 11 23:15:01 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD, size 20.69 MB, duration 8.89 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:15:01 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Image download 20.69 MB at 2.33 MB/s Sep 11 23:15:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a2face-425c-482e-b248-7fbc97b65497]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:01 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD Sep 11 23:15:01 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:01 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:01 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Temporary image 04640a5b-a2f5-4fdb-814b-43b62004d534 is fetched for user aa21b1401b8c4a498abe1a0b30d9b403. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da4c5c-cede-404d-98da-4a5c392defcf]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:02 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD Sep 11 23:15:02 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Flow 'volume_create_manager' (7191a9c4-e173-4346-9c4d-694eae198ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8186b30c-6267-4bfc-989f-3cfffa486252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8186b30c-6267-4bfc-989f-3cfffa486252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-606360833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa59a1a-c519-4b25-b330-e594d6ac8770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b43caa7474048ab4ba2c921bdb3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:02Z,use_quota=True,user_id='480d3fc7e60e4c4eb3fa46b7b64669b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77482d79-0b9d-4fe4-a15e-77d7b42ea392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77482d79-0b9d-4fe4-a15e-77d7b42ea392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a31703-6d34-475b-a9bf-d19bd681dcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a31703-6d34-475b-a9bf-d19bd681dcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa59a1a-c519-4b25-b330-e594d6ac8770', 'volume_name': 'volume-0aa59a1a-c519-4b25-b330-e594d6ac8770', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f50982f-c468-4290-80bb-06b1e66b01a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f50982f-c468-4290-80bb-06b1e66b01a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075ac2e2-b5c1-4d16-8eba-363015c8bfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:02 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Volume 0aa59a1a-c519-4b25-b330-e594d6ac8770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa59a1a-c519-4b25-b330-e594d6ac8770', 'volume_size': 1} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-606360833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa59a1a-c519-4b25-b330-e594d6ac8770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b43caa7474048ab4ba2c921bdb3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:02Z,use_quota=True,user_id='480d3fc7e60e4c4eb3fa46b7b64669b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Creating volume 0aa59a1a-c519-4b25-b330-e594d6ac8770 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:02 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:02 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 1073741824 Sep 11 23:15:02 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:02 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:02 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 1073741824" returned: 0 in 0.552s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:03 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 Sep 11 23:15:03 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:03 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770" returned: 0 in 0.320s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1412798410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd8c407-3f16-46a0-b0b1-8ee00c229c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb542f4eba994ee19b07ef7389eb9bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:51Z,use_quota=True,user_id='aa21b1401b8c4a498abe1a0b30d9b403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913c2bb5-d395-49d9-8d9c-bd8ab680d95f),volume_type_id=913c2bb5-d395-49d9-8d9c-bd8ab680d95f)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Creating volume 3fd8c407-3f16-46a0-b0b1-8ee00c229c13 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:03 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075ac2e2-b5c1-4d16-8eba-363015c8bfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa59a1a-c519-4b25-b330-e594d6ac8770', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068728a2-9c97-421e-90a9-134fd3dbcc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:03 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 1073741824 Sep 11 23:15:03 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:03 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Volume volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 (0aa59a1a-c519-4b25-b330-e594d6ac8770): created successfully Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068728a2-9c97-421e-90a9-134fd3dbcc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Flow 'volume_create_manager' (7191a9c4-e173-4346-9c4d-694eae198ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2248a6fe-e3a2-4c40-be9e-ef80922b2542 tempest-TestImageHashVerification-836324244 None] Created volume successfully. Sep 11 23:15:04 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 1073741824" returned: 0 in 0.569s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:04 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 Sep 11 23:15:04 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:04 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13" returned: 0 in 0.296s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Attempting download of 04640a5b-a2f5-4fdb-814b-43b62004d534 ((None, [{'url': 'file:///opt/stack/data/glance/images/04640a5b-a2f5-4fdb-814b-43b62004d534', 'metadata': {}}])) to volume 3fd8c407-3f16-46a0-b0b1-8ee00c229c13. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f632ad3e-45fa-45d6-a4ed-01e00f1ee1bb]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04640a5b-a2f5-4fdb-814b-43b62004d534_s8yco1ez {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:04 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04640a5b-a2f5-4fdb-814b-43b62004d534_s8yco1ez Sep 11 23:15:04 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:04 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04640a5b-a2f5-4fdb-814b-43b62004d534_s8yco1ez" returned: 0 in 0.408s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04640a5b-a2f5-4fdb-814b-43b62004d534_s8yco1ez {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:05 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04640a5b-a2f5-4fdb-814b-43b62004d534_s8yco1ez Sep 11 23:15:05 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:05 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04640a5b-a2f5-4fdb-814b-43b62004d534_s8yco1ez" returned: 1 in 0.486s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04640a5b-a2f5-4fdb-814b-43b62004d534_s8yco1ez' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2515b2-f0a1-4d8d-8730-62f436b0090b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:05 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD Sep 11 23:15:05 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a2482-0223-434a-b2eb-46e0d88a36bc]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:05 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] 04640a5b-a2f5-4fdb-814b-43b62004d534 was qcow2, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:15:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:05 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 Sep 11 23:15:05 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:05 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 Sep 11 23:15:05 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:06 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770" returned: 0 in 0.443s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:06 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823b963-216f-449e-a2c6-2597a8054f17]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:06 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 Sep 11 23:15:06 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:06 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770" returned: 0 in 0.523s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 /opt/stack/data/cinder/conversion/0aa59a1a-c519-4b25-b330-e594d6ac8770.temp_image.dec4d13b-cfd2-45cf-b078-430efb6dd40fzas1331w.img {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:06 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 /opt/stack/data/cinder/conversion/0aa59a1a-c519-4b25-b330-e594d6ac8770.temp_image.dec4d13b-cfd2-45cf-b078-430efb6dd40fzas1331w.img Sep 11 23:15:06 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:08 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13" returned: 0 in 2.656s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:08 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04640a5b-a2f5-4fdb-814b-43b62004d534_m_o99f7pdevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:15:08 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Converted 112.00 MB image at 42.11 MB/s Sep 11 23:15:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:08 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 1G Sep 11 23:15:08 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:09 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 1G" returned: 0 in 0.898s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Downloaded image 04640a5b-a2f5-4fdb-814b-43b62004d534 ((None, [{'url': 'file:///opt/stack/data/glance/images/04640a5b-a2f5-4fdb-814b-43b62004d534', 'metadata': {}}])) to volume 3fd8c407-3f16-46a0-b0b1-8ee00c229c13 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Temporary image 04640a5b-a2f5-4fdb-814b-43b62004d534 for user aa21b1401b8c4a498abe1a0b30d9b403 is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Marking volume 3fd8c407-3f16-46a0-b0b1-8ee00c229c13 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Copying metadata from image 04640a5b-a2f5-4fdb-814b-43b62004d534 to 3fd8c407-3f16-46a0-b0b1-8ee00c229c13. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Creating volume glance metadata for volume 3fd8c407-3f16-46a0-b0b1-8ee00c229c13 backed by image 04640a5b-a2f5-4fdb-814b-43b62004d534 with: {'image_id': '04640a5b-a2f5-4fdb-814b-43b62004d534', 'image_name': 'tempest-scenario-img--1159438117', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4803ff9-ca75-425e-98c0-9d55f85c04df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13', 'volume_size': 1, 'image_id': '04640a5b-a2f5-4fdb-814b-43b62004d534', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04640a5b-a2f5-4fdb-814b-43b62004d534', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1159438117', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb542f4eba994ee19b07ef7389eb9bc5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04640a5b-a2f5-4fdb-814b-43b62004d534', 'created_at': datetime.datetime(2026, 9, 11, 21, 14, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 14, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04640a5b-a2f5-4fdb-814b-43b62004d534/file', 'properties': {}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb94f12-71b1-4947-8ae3-da0979601cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:09 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Volume volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 (3fd8c407-3f16-46a0-b0b1-8ee00c229c13): created successfully Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb94f12-71b1-4947-8ae3-da0979601cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Flow 'volume_create_manager' (896ae054-df83-47b1-94e5-f3e152e8de30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c1315194-0496-41de-bbb9-a1bff8ff4985 tempest-TestInstancesWithCinderVolumes-338863730 None] Created volume successfully. Sep 11 23:15:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:15:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:11 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:15:11 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:12 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.966s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:12 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:12 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:15:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:15:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:15:12 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 /opt/stack/data/cinder/conversion/0aa59a1a-c519-4b25-b330-e594d6ac8770.temp_image.dec4d13b-cfd2-45cf-b078-430efb6dd40fzas1331w.img" returned: 0 in 6.001s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:12 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a7ff97-5879-4879-8d50-dc8032337519]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:12 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 Sep 11 23:15:12 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:13 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770" returned: 0 in 0.614s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:13 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/conversion/0aa59a1a-c519-4b25-b330-e594d6ac8770.temp_image.dec4d13b-cfd2-45cf-b078-430efb6dd40fzas1331w.img {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:15:13 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Converted 1024.00 MB image at 170.60 MB/s Sep 11 23:15:13 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] dec4d13b-cfd2-45cf-b078-430efb6dd40f was raw, no need to convert to raw {{(pid=88026) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 11 23:15:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-f1cfbaf9-e828-4a24-827b-bd3617d7385c req-095c7409-23e9-45d5-aa27-53a872982b71 tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:28 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=29,cinder:UPDATE=14,cinder:INSERT=8 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:15:28 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=33,cinder:UPDATE=26,cinder:DELETE=6,cinder:INSERT=7 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:15:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.383s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Uploaded volume to glance image-id: dec4d13b-cfd2-45cf-b078-430efb6dd40f. {{(pid=88026) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 11 23:15:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-f1cfbaf9-e828-4a24-827b-bd3617d7385c req-095c7409-23e9-45d5-aa27-53a872982b71 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.088s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-f1cfbaf9-e828-4a24-827b-bd3617d7385c req-095c7409-23e9-45d5-aa27-53a872982b71 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8cd5fcc1-bde4-47ea-b8cf-d95120bc4a59 tempest-TestImageHashVerification-836324244 None] Copy volume to image completed successfully. Sep 11 23:15:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-f1cfbaf9-e828-4a24-827b-bd3617d7385c req-095c7409-23e9-45d5-aa27-53a872982b71 tempest-TestInstancesWithCinderVolumes-338863730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a269889-b703-46d3-893a-de7e69b3597c', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:15:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-f1cfbaf9-e828-4a24-827b-bd3617d7385c req-095c7409-23e9-45d5-aa27-53a872982b71 tempest-TestInstancesWithCinderVolumes-338863730 None] attachment_update completed successfully. Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Acquiring lock "cinder-0aa59a1a-c519-4b25-b330-e594d6ac8770-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Lock "cinder-0aa59a1a-c519-4b25-b330-e594d6ac8770-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Acquiring lock "cinder-quobyte-0aa59a1a-c519-4b25-b330-e594d6ac8770" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Lock "cinder-quobyte-0aa59a1a-c519-4b25-b330-e594d6ac8770" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfb6e5e-e1c4-49af-bb62-d48bc29860be]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:35 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 Sep 11 23:15:35 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:35 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770" returned: 0 in 0.398s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:35 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770 Sep 11 23:15:35 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:35 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0aa59a1a-c519-4b25-b330-e594d6ac8770" returned: 0 in 0.383s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Lock "cinder-quobyte-0aa59a1a-c519-4b25-b330-e594d6ac8770" released by "delete_volume" :: held 0.824s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Created reservations ['ad4b75ca-7c29-432b-a47a-d4e1b1e23316', 'cee11f86-4973-4d6c-b0d7-1b7eaa55ce97', 'f4f5694b-662f-47ca-8c5c-939931889071', '05432a6e-8ba6-479e-91fe-df9e632ad4ec'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:36 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:15:36 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:36 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.332s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:36 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Deleted volume successfully. Sep 11 23:15:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-af2b5aa1-9289-45d2-96cc-1c83bdb13f5d tempest-TestImageHashVerification-836324244 None] Lock "cinder-0aa59a1a-c519-4b25-b330-e594d6ac8770-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-6b87f1af-b0a9-4032-94a1-b8e4d59e237c req-e08e3dfb-072c-438d-9992-ddad88f60c29 tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-6b87f1af-b0a9-4032-94a1-b8e4d59e237c req-e08e3dfb-072c-438d-9992-ddad88f60c29 tempest-TestStampPattern-1316296137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-6b87f1af-b0a9-4032-94a1-b8e4d59e237c req-e08e3dfb-072c-438d-9992-ddad88f60c29 tempest-TestStampPattern-1316296137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-6b87f1af-b0a9-4032-94a1-b8e4d59e237c req-e08e3dfb-072c-438d-9992-ddad88f60c29 tempest-TestStampPattern-1316296137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccc26b88-a0b0-44fc-8e17-8b15e9253c5f', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:15:43 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-6b87f1af-b0a9-4032-94a1-b8e4d59e237c req-e08e3dfb-072c-438d-9992-ddad88f60c29 tempest-TestStampPattern-1316296137 None] attachment_update completed successfully. Sep 11 23:15:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-17d4852d-6dcc-4b7d-b8b1-0d2af642a746 req-5bf2346c-01f3-43b1-85a0-79dc9c2ca272 tempest-TestStampPattern-1316296137 None] Terminate volume connection completed successfully. Sep 11 23:15:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-17d4852d-6dcc-4b7d-b8b1-0d2af642a746 req-5bf2346c-01f3-43b1-85a0-79dc9c2ca272 tempest-TestStampPattern-1316296137 None] Deleting attachment ccc26b88-a0b0-44fc-8e17-8b15e9253c5f. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (5e096ce0-cc09-425b-a264-f3e7fdeb973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ba1120-4c3e-49b9-a24d-61ba15007d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ba1120-4c3e-49b9-a24d-61ba15007d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660775566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36211b16-0a1d-49f7-94eb-48d9b5aa3a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:52Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0e59a3-6e33-411d-9d5a-c1841f635e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0e59a3-6e33-411d-9d5a-c1841f635e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609573de-51e1-4a05-ac21-4e06d2324a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609573de-51e1-4a05-ac21-4e06d2324a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36211b16-0a1d-49f7-94eb-48d9b5aa3a4a', 'volume_name': 'volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af75cd-e94e-4309-b52d-d3809225f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af75cd-e94e-4309-b52d-d3809225f231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111d06f2-61bf-4ce2-998e-747b47747a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume 36211b16-0a1d-49f7-94eb-48d9b5aa3a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a', 'volume_size': 1} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660775566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36211b16-0a1d-49f7-94eb-48d9b5aa3a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:52Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Creating volume 36211b16-0a1d-49f7-94eb-48d9b5aa3a4a {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:52 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Lock "cinder-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:52 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a 1073741824 Sep 11 23:15:52 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-quobyte-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee6b7f-bc3e-4e50-9134-b8f01adf5396]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:52 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 Sep 11 23:15:52 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:52 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a 1073741824" returned: 0 in 0.497s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:52 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a Sep 11 23:15:52 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:52 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" returned: 0 in 0.442s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:52 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1 Sep 11 23:15:52 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:53 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a" returned: 0 in 0.273s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:53 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111d06f2-61bf-4ce2-998e-747b47747a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bd0f35-17ce-4685-a7f4-1a48423404a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" returned: 0 in 0.264s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1" released by "delete_volume" :: held 0.754s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:53 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a (36211b16-0a1d-49f7-94eb-48d9b5aa3a4a): created successfully Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bd0f35-17ce-4685-a7f4-1a48423404a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (5e096ce0-cc09-425b-a264-f3e7fdeb973a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1d24ac5a-6f92-42ee-ac6b-a2acc2ed07ed tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created volume successfully. Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Created reservations ['5ffa4703-9331-4580-9214-56ed71f7b6a3', '0f75c481-d371-415c-863a-5bf2b171f480', '4e2749a4-3c8d-437d-a34b-cdd63f77511a', 'e2b67ffa-555d-497c-9f7a-03d1765aa234'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:53 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:15:53 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:53 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:15:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Deleted volume successfully. Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-81c834cf-b245-45b0-bf32-bc7c6c27bdba tempest-TestStampPattern-1316296137 None] Lock "cinder-4c23ea6a-8fd0-4a09-8df5-0e7e4f874eb1-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Lock "cinder-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-quobyte-3cd30796-2e28-4516-9d2f-046e6bceeded" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-3cd30796-2e28-4516-9d2f-046e6bceeded" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-quobyte-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Deleting offline snapshot a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 of volume 3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] snapshot_file for this snap is: volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc7391-79c1-4a29-9d99-ce1ed67edc4b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:53 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 Sep 11 23:15:53 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:54 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" returned: 0 in 0.349s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cd30796-2e28-4516-9d2f-046e6bceeded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[46730074-5eef-4195-bd28-bb680dea9bc7]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:54 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded Sep 11 23:15:54 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:54 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded" returned: 0 in 0.516s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:54 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 Sep 11 23:15:54 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (313ca3a3-fe3c-4672-9420-d86fc5595902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a723c601-fe81-4608-9c2d-045ec1637438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a723c601-fe81-4608-9c2d-045ec1637438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879306919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7197cec-1039-4039-abd3-5731927bd35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:55Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851fc33f-9b1c-4dc2-87dc-dc8bba820a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851fc33f-9b1c-4dc2-87dc-dc8bba820a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbaeb6ed-fad8-4bed-9834-07fda1afef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbaeb6ed-fad8-4bed-9834-07fda1afef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7197cec-1039-4039-abd3-5731927bd35e', 'volume_name': 'volume-a7197cec-1039-4039-abd3-5731927bd35e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee92b55-d1f5-4aad-b1ad-c810e902cb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee92b55-d1f5-4aad-b1ad-c810e902cb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307a0d01-c8b0-43cc-801d-bca2f5bbc375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:54 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume a7197cec-1039-4039-abd3-5731927bd35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7197cec-1039-4039-abd3-5731927bd35e', 'volume_size': 1} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879306919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7197cec-1039-4039-abd3-5731927bd35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:55Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Creating volume a7197cec-1039-4039-abd3-5731927bd35e {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:54 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:15:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:54 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e 1073741824 Sep 11 23:15:54 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:55 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" returned: 0 in 0.434s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:55 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15 Sep 11 23:15:55 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (d63f0bea-7784-4d19-ada9-2c3061545753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a0e1c9-a2d1-46b2-8748-cdf30f1b6291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a0e1c9-a2d1-46b2-8748-cdf30f1b6291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1513104173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590d3ed2-97fa-4d95-8cb0-1507ebc82d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:55Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d4cb57-81e3-487b-8d32-3e5d43418bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d4cb57-81e3-487b-8d32-3e5d43418bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035ef2ee-cfb7-4a4d-b383-ed1020880595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035ef2ee-cfb7-4a4d-b383-ed1020880595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590d3ed2-97fa-4d95-8cb0-1507ebc82d01', 'volume_name': 'volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ad85b7-68c9-4042-ad9e-9622bd1df69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ad85b7-68c9-4042-ad9e-9622bd1df69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b06adb3-eafb-47f3-bd77-1fa5e3dc7c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume 590d3ed2-97fa-4d95-8cb0-1507ebc82d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01', 'volume_size': 1} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:55 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded.a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:55 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e 1073741824" returned: 0 in 0.614s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15" released by "_delete_snapshot" :: held 1.753s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-3cd30796-2e28-4516-9d2f-046e6bceeded" released by "delete_snapshot" :: held 1.784s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:55 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e Sep 11 23:15:55 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (578fdcb9-babe-4ee6-8790-b978d36dab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba112d8-5fbf-46ac-ab81-09ad01fea31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Created reservations ['b0f770ad-9aad-41dc-ba95-35e74513889f', '4560ffd1-1933-4c92-b51f-2d7bd69a0f95', 'ea00c37b-3bd7-4380-991a-6c0882a88aba', '5a099a37-f7b6-4deb-b8bf-9c4fdb2f6245'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba112d8-5fbf-46ac-ab81-09ad01fea31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410149985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ee064f-84b4-430a-9d32-b52bc1257c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:56Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77699cfe-5f6c-4a86-8b16-ac56b0f3524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77699cfe-5f6c-4a86-8b16-ac56b0f3524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5539b1d3-45eb-431a-ad2b-3ec3236ff4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5539b1d3-45eb-431a-ad2b-3ec3236ff4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ee064f-84b4-430a-9d32-b52bc1257c83', 'volume_name': 'volume-72ee064f-84b4-430a-9d32-b52bc1257c83', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436c6a27-1d06-4c07-9218-b373458a5e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436c6a27-1d06-4c07-9218-b373458a5e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156ee892-a227-48df-bf01-dccb6894e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume 72ee064f-84b4-430a-9d32-b52bc1257c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ee064f-84b4-430a-9d32-b52bc1257c83', 'volume_size': 1} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Delete snapshot completed successfully. Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-324f409a-708d-462b-a634-bb6920505ad0 tempest-TestStampPattern-1316296137 None] Lock "cinder-a4e11b9d-7a24-4aa0-a0ad-ef32a11fcb15-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:15:55 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e" returned: 0 in 0.344s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1513104173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590d3ed2-97fa-4d95-8cb0-1507ebc82d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:55Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Creating volume 590d3ed2-97fa-4d95-8cb0-1507ebc82d01 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:55 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307a0d01-c8b0-43cc-801d-bca2f5bbc375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7197cec-1039-4039-abd3-5731927bd35e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96191e7d-271a-46d9-8165-b20a9e880bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:55 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 1073741824 Sep 11 23:15:55 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:55 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume volume-a7197cec-1039-4039-abd3-5731927bd35e (a7197cec-1039-4039-abd3-5731927bd35e): created successfully Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96191e7d-271a-46d9-8165-b20a9e880bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (313ca3a3-fe3c-4672-9420-d86fc5595902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a187b2de-f419-4a8c-a300-dcde5bed680f tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created volume successfully. Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (9ae52871-0597-4119-a3c1-3bdd8dd17705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40090b08-656a-4d42-888a-3d0b00e222cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40090b08-656a-4d42-888a-3d0b00e222cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498123239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:56Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30dd9592-3f5a-48bd-b15b-1d77c5886f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30dd9592-3f5a-48bd-b15b-1d77c5886f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b1ed47-6738-40e9-8998-ac5426452c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b1ed47-6738-40e9-8998-ac5426452c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242', 'volume_name': 'volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac90496f-81d9-4484-93e1-56807e512494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac90496f-81d9-4484-93e1-56807e512494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a4b55d-d026-4749-b39f-52b26970fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume 2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242', 'volume_size': 1} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:56 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 1073741824" returned: 0 in 0.626s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (5493236a-1816-4d54-8e06-a943b947cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c430b48a-c552-4dac-84d6-2c40f7fd6e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c430b48a-c552-4dac-84d6-2c40f7fd6e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342827957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c723fa3-95cc-4d1e-8cc3-16b067b81a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:57Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2befdf2b-23bc-4398-b4c5-863df22e43d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2befdf2b-23bc-4398-b4c5-863df22e43d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13db34c2-2449-45f1-81cb-3ff8c1411a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13db34c2-2449-45f1-81cb-3ff8c1411a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c723fa3-95cc-4d1e-8cc3-16b067b81a92', 'volume_name': 'volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541c901f-07cd-4656-bd8b-42463a55f9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541c901f-07cd-4656-bd8b-42463a55f9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c88518-614a-452e-b68a-746fb6ca1c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:56 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume 8c723fa3-95cc-4d1e-8cc3-16b067b81a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92', 'volume_size': 1} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:56 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 Sep 11 23:15:56 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:56 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01" returned: 0 in 0.304s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410149985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ee064f-84b4-430a-9d32-b52bc1257c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:56Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Creating volume 72ee064f-84b4-430a-9d32-b52bc1257c83 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:56 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:15:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b06adb3-eafb-47f3-bd77-1fa5e3dc7c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:57 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 1073741824 Sep 11 23:15:57 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7db8115-7e6d-4ad3-a9d6-3e7520c19904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:57 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 (590d3ed2-97fa-4d95-8cb0-1507ebc82d01): created successfully Sep 11 23:15:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7db8115-7e6d-4ad3-a9d6-3e7520c19904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (d63f0bea-7784-4d19-ada9-2c3061545753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:57 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8944be30-43e1-472f-85e6-12bf632dd034 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created volume successfully. Sep 11 23:15:57 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 1073741824" returned: 0 in 0.618s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:57 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 Sep 11 23:15:57 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:58 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83" returned: 0 in 0.415s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.912s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498123239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:56Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Creating volume 2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:58 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156ee892-a227-48df-bf01-dccb6894e651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ee064f-84b4-430a-9d32-b52bc1257c83', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:58 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 1073741824 Sep 11 23:15:58 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b461196-7937-46be-a120-ff9e6331c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:58 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume volume-72ee064f-84b4-430a-9d32-b52bc1257c83 (72ee064f-84b4-430a-9d32-b52bc1257c83): created successfully Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b461196-7937-46be-a120-ff9e6331c13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (578fdcb9-babe-4ee6-8790-b978d36dab24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-97e84217-b87c-4fb8-8277-b2571d468588 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created volume successfully. Sep 11 23:15:58 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 1073741824" returned: 0 in 0.541s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:58 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 Sep 11 23:15:58 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:58 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:15:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.343s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-342827957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c723fa3-95cc-4d1e-8cc3-16b067b81a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d99eaaeced449eb971d146622d6cfd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:57Z,use_quota=True,user_id='329d97e7a2a04180906cc70b3926db7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Creating volume 8c723fa3-95cc-4d1e-8cc3-16b067b81a92 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:15:59 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a4b55d-d026-4749-b39f-52b26970fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510ef978-912e-4598-a0a2-b683cb9cfa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:15:59 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 1073741824 Sep 11 23:15:59 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:15:59 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 (2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242): created successfully Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510ef978-912e-4598-a0a2-b683cb9cfa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (9ae52871-0597-4119-a3c1-3bdd8dd17705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:15:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-69deb813-74e8-472f-b7da-aab543f260c1 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created volume successfully. Sep 11 23:15:59 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 1073741824" returned: 0 in 0.666s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:15:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:15:59 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 Sep 11 23:15:59 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:00 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92" returned: 0 in 0.312s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c88518-614a-452e-b68a-746fb6ca1c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbc3d8d-6cc1-4eef-94f3-15f06741d187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:00 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Volume volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 (8c723fa3-95cc-4d1e-8cc3-16b067b81a92): created successfully Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbc3d8d-6cc1-4eef-94f3-15f06741d187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Flow 'volume_create_manager' (5493236a-1816-4d54-8e06-a943b947cf57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-491ea6ae-4d20-4a40-ba94-53a489dc0f0e tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created volume successfully. Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-3cd30796-2e28-4516-9d2f-046e6bceeded-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Lock "cinder-3cd30796-2e28-4516-9d2f-046e6bceeded-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Acquiring lock "cinder-quobyte-3cd30796-2e28-4516-9d2f-046e6bceeded" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-3cd30796-2e28-4516-9d2f-046e6bceeded" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b5ae52-95d4-40a2-9ce1-2d6dd1dcd1a2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:00 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded Sep 11 23:16:00 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:00 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded" returned: 0 in 0.365s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:00 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded Sep 11 23:16:00 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:01 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-8c723fa3-95cc-4d1e-8cc3-16b067b81a92-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3cd30796-2e28-4516-9d2f-046e6bceeded" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-8c723fa3-95cc-4d1e-8cc3-16b067b81a92-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Lock "cinder-quobyte-3cd30796-2e28-4516-9d2f-046e6bceeded" released by "delete_volume" :: held 0.729s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-quobyte-8c723fa3-95cc-4d1e-8cc3-16b067b81a92" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-8c723fa3-95cc-4d1e-8cc3-16b067b81a92" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Created reservations ['504582de-a6fb-46d3-ab6f-78f6dc74f8f2', '58eff01d-f867-4d78-98eb-7627454431f4', '422baaec-526f-48be-9ddb-020aaff3bd54', '848f939f-fe42-48b0-a204-7d9c75b51071'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047181d-2502-4cd5-a276-cb70d8bf45f8]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:01 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:01 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:01 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 Sep 11 23:16:01 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:01 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.309s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Deleted volume successfully. Sep 11 23:16:01 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92" returned: 0 in 0.466s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-154643d8-f83e-4683-b47a-c47025582964 tempest-TestStampPattern-1316296137 None] Lock "cinder-3cd30796-2e28-4516-9d2f-046e6bceeded-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:01 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92 Sep 11 23:16:01 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:02 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8c723fa3-95cc-4d1e-8cc3-16b067b81a92" returned: 0 in 0.275s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-8c723fa3-95cc-4d1e-8cc3-16b067b81a92" released by "delete_volume" :: held 0.798s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created reservations ['58160dcf-30a7-4135-95b2-2698bd8bfd44', 'b8fdbf1b-fbf0-4d61-9574-8ec915ab2781', 'f0686fb5-5d59-4e2e-bf7e-b4e9fb83f1a9', 'e53701fd-0ba0-4ecf-a10e-e0b60543c1b4'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:02 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:02 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:02 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Deleted volume successfully. Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-quobyte-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-59982c16-fefd-4e35-a690-4e6cf34123c3 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-8c723fa3-95cc-4d1e-8cc3-16b067b81a92-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[086ccc35-0b1b-44a5-9ff4-41253983c724]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:02 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 Sep 11 23:16:02 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:03 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242" returned: 0 in 0.420s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:03 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242 Sep 11 23:16:03 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:03 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242" returned: 0 in 0.270s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242" released by "delete_volume" :: held 0.730s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created reservations ['b67418b0-f3c3-4c5e-9a58-83faaa3432dc', '423f985c-0acc-47e5-a55b-e6c6ed083c14', 'dbd924f6-d7d8-46c6-9c90-94670c2546d2', '2c791a02-2f58-413b-98de-7f026d68415f'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:03 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:03 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-72ee064f-84b4-430a-9d32-b52bc1257c83-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-72ee064f-84b4-430a-9d32-b52bc1257c83-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-quobyte-72ee064f-84b4-430a-9d32-b52bc1257c83" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-72ee064f-84b4-430a-9d32-b52bc1257c83" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a320d2b-c4ef-4b2f-a882-28e6515f73b9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:03 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.335s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Deleted volume successfully. Sep 11 23:16:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8caedf9e-1096-43cb-b1e6-ae1c9a3064dc tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-2a7a6e8d-b64c-47ac-8f8f-c4a5b9a34242-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:03 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 Sep 11 23:16:03 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:04 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83" returned: 0 in 0.384s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:04 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83 Sep 11 23:16:04 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:04 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-72ee064f-84b4-430a-9d32-b52bc1257c83" returned: 0 in 0.272s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-72ee064f-84b4-430a-9d32-b52bc1257c83" released by "delete_volume" :: held 0.703s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created reservations ['a6098ec0-6fb9-4033-ab87-5a8d887d12da', 'b72f66b5-34c0-4f9b-8b14-c91e60314fdd', '8f6883d5-e302-4e52-97cd-6057d6f25039', '017a55ce-7f75-4294-9ef8-07ccf759dd67'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:04 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:04 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-590d3ed2-97fa-4d95-8cb0-1507ebc82d01-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:04 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.312s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:04 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:05 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Deleted volume successfully. Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-590d3ed2-97fa-4d95-8cb0-1507ebc82d01-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-ab7e72cb-64ea-4622-8374-c4fa1f0661c4 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-72ee064f-84b4-430a-9d32-b52bc1257c83-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-quobyte-590d3ed2-97fa-4d95-8cb0-1507ebc82d01" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-590d3ed2-97fa-4d95-8cb0-1507ebc82d01" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a4ba62-ffab-47ad-96dc-f8564720fbe1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:05 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 Sep 11 23:16:05 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:05 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01" returned: 0 in 0.408s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:05 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01 Sep 11 23:16:05 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:05 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-590d3ed2-97fa-4d95-8cb0-1507ebc82d01" returned: 0 in 0.285s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-590d3ed2-97fa-4d95-8cb0-1507ebc82d01" released by "delete_volume" :: held 0.743s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created reservations ['67736c56-69dd-47f5-a74c-0fe36de6e3bd', 'a070a26a-32c6-4010-9f44-e9280ad202bf', '1fef898d-f6ef-429f-b219-5c6a2c32c9c0', '070b4a6e-a1af-4a78-a280-2f403430f360'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-fb84e952-fd34-47e2-bfc9-74c0c3454a52 req-8b84bbeb-6b10-4907-8b3b-4485ea01d5fc tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-fb84e952-fd34-47e2-bfc9-74c0c3454a52 req-8b84bbeb-6b10-4907-8b3b-4485ea01d5fc tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-fb84e952-fd34-47e2-bfc9-74c0c3454a52 req-8b84bbeb-6b10-4907-8b3b-4485ea01d5fc tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-fb84e952-fd34-47e2-bfc9-74c0c3454a52 req-8b84bbeb-6b10-4907-8b3b-4485ea01d5fc tempest-TestInstancesWithCinderVolumes-338863730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-2c0c724b-2123-4a63-8545-75c877574909', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '318236ef-fff8-4595-8375-75c07748fd94', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:16:06 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:06 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-fb84e952-fd34-47e2-bfc9-74c0c3454a52 req-8b84bbeb-6b10-4907-8b3b-4485ea01d5fc tempest-TestInstancesWithCinderVolumes-338863730 None] attachment_update completed successfully. Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-a7197cec-1039-4039-abd3-5731927bd35e-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-a7197cec-1039-4039-abd3-5731927bd35e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-quobyte-a7197cec-1039-4039-abd3-5731927bd35e" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-a7197cec-1039-4039-abd3-5731927bd35e" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:06 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.399s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08caa281-1591-4a51-8d75-246e2ac0cc47]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Deleted volume successfully. Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8b14fe69-a37b-44ac-be4d-779281ababc9 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-590d3ed2-97fa-4d95-8cb0-1507ebc82d01-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:06 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e Sep 11 23:16:06 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:06 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e" returned: 0 in 0.534s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:06 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e Sep 11 23:16:06 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:07 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a7197cec-1039-4039-abd3-5731927bd35e" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-a7197cec-1039-4039-abd3-5731927bd35e" released by "delete_volume" :: held 0.885s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created reservations ['4818b469-65ba-4f52-be51-94814f82929d', '8367ea69-d814-41dc-ae35-9a13efc2c26d', '466a77cb-658c-4caf-b0b4-1f1d4f895552', '5f0c6333-72c9-4d69-a739-075904d39c9c'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:07 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:07 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "cinder-quobyte-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b09ac55-3394-4dbb-a40b-3893b74e478c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:07 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.325s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:07 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Deleted volume successfully. Sep 11 23:16:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f1bcfec9-b401-4347-b085-9bb1aea1d9a8 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-a7197cec-1039-4039-abd3-5731927bd35e-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:07 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a Sep 11 23:16:07 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:08 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a" returned: 0 in 0.404s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:08 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a Sep 11 23:16:08 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:08 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a" returned: 0 in 0.302s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-quobyte-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a" released by "delete_volume" :: held 0.766s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Created reservations ['3a85d127-9d33-4ceb-bd30-d805cb0aff0b', '7521807a-bec4-46fa-8bdc-790c863b1647', 'cb839485-8636-401e-af14-9181291c0c71', '6bcff54f-141f-4b6f-bbad-1086f5a00981'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:08 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:08 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:08 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.320s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:08 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Deleted volume successfully. Sep 11 23:16:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4bf9d1e2-ed8a-42e6-acb6-ed6c251c8669 tempest-CreateVolumesFromSourceVolumeTest-2075928930 None] Lock "cinder-36211b16-0a1d-49f7-94eb-48d9b5aa3a4a-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-0ab2675f-cdb7-42e2-99bd-f4ee3e20f8c4 req-749e6cfc-2e6e-42ff-b454-6a7d6f7b0a91 tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-0ab2675f-cdb7-42e2-99bd-f4ee3e20f8c4 req-749e6cfc-2e6e-42ff-b454-6a7d6f7b0a91 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-0ab2675f-cdb7-42e2-99bd-f4ee3e20f8c4 req-749e6cfc-2e6e-42ff-b454-6a7d6f7b0a91 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:09 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-0ab2675f-cdb7-42e2-99bd-f4ee3e20f8c4 req-749e6cfc-2e6e-42ff-b454-6a7d6f7b0a91 tempest-TestInstancesWithCinderVolumes-338863730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f678400-9ff2-4c33-92fa-f490bb17c6ae', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:16:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-0ab2675f-cdb7-42e2-99bd-f4ee3e20f8c4 req-749e6cfc-2e6e-42ff-b454-6a7d6f7b0a91 tempest-TestInstancesWithCinderVolumes-338863730 None] attachment_update completed successfully. Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:11 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:11 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:11 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.321s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:16:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Flow 'volume_create_manager' (e539870c-f213-4112-bbf4-41d0c082268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52283c3c-b02b-48bb-8160-3da3f0867ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52283c3c-b02b-48bb-8160-3da3f0867ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1232338002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84515aa5-6bfc-49e2-94f7-d94f6ebcab47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877b27c7a1e24b57a94d077d22ffb8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:12Z,use_quota=True,user_id='630aed13a9b541dbb1d74688f01ff5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818a42df-8e70-4da1-b444-bfb44e710d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818a42df-8e70-4da1-b444-bfb44e710d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb87211-dbdd-4404-a6e4-dd20b820c0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb87211-dbdd-4404-a6e4-dd20b820c0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84515aa5-6bfc-49e2-94f7-d94f6ebcab47', 'volume_name': 'volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512c1424-7d74-4886-9cf7-bef57a41cb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512c1424-7d74-4886-9cf7-bef57a41cb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffaac39d-a973-4689-9568-5762cd098c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:12 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Volume 84515aa5-6bfc-49e2-94f7-d94f6ebcab47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47', 'volume_size': 1} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1232338002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84515aa5-6bfc-49e2-94f7-d94f6ebcab47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877b27c7a1e24b57a94d077d22ffb8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:12Z,use_quota=True,user_id='630aed13a9b541dbb1d74688f01ff5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Creating volume 84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:12 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:12 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 1073741824 Sep 11 23:16:12 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:13 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 1073741824" returned: 0 in 0.601s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:13 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 Sep 11 23:16:13 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:13 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" returned: 0 in 0.337s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffaac39d-a973-4689-9568-5762cd098c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b21e382-ffcf-4c82-8b1b-a12518ba23b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Volume volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 (84515aa5-6bfc-49e2-94f7-d94f6ebcab47): created successfully Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b21e382-ffcf-4c82-8b1b-a12518ba23b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Flow 'volume_create_manager' (e539870c-f213-4112-bbf4-41d0c082268f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:13 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3f50de31-462f-42ab-a03d-c5801ef65e21 tempest-VolumeDependencyTests-1320794160 None] Created volume successfully. Sep 11 23:16:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-883c9985-1ea4-4fb7-8a06-f17a2a1f5a05 req-d34d64b8-73df-4b45-8ff3-449d2d5edd43 tempest-TestInstancesWithCinderVolumes-338863730 None] Terminate volume connection completed successfully. Sep 11 23:16:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-883c9985-1ea4-4fb7-8a06-f17a2a1f5a05 req-d34d64b8-73df-4b45-8ff3-449d2d5edd43 tempest-TestInstancesWithCinderVolumes-338863730 None] Deleting attachment 318236ef-fff8-4595-8375-75c07748fd94. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:16:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Creating offline snapshot 46707ac1-2424-438e-ab16-e2920e437cac of volume 84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:16:14 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[142b15c3-7aee-492d-bea0-fe0c2b86742b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:15 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 Sep 11 23:16:15 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:15 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" returned: 0 in 0.411s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "cinder-2c0c724b-2123-4a63-8545-75c877574909-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:15 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac 1G Sep 11 23:16:15 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-2c0c724b-2123-4a63-8545-75c877574909-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "cinder-quobyte-2c0c724b-2123-4a63-8545-75c877574909" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-quobyte-2c0c724b-2123-4a63-8545-75c877574909" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a10d455-2069-449e-b172-804d1c4385b0]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:15 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 Sep 11 23:16:15 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:15 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909" returned: 0 in 0.452s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:15 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac 1G" returned: 0 in 0.660s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:15 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909 Sep 11 23:16:15 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:16 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac Sep 11 23:16:16 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:16 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c0c724b-2123-4a63-8545-75c877574909" returned: 0 in 0.341s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-quobyte-2c0c724b-2123-4a63-8545-75c877574909" released by "delete_volume" :: held 0.861s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:16 devstack cinder-volume[88026]: WARNING cinder.quota [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1019531318-1296064451 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1019531318-1296064451, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:16:16 devstack cinder-volume[88026]: WARNING cinder.quota [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1019531318-1296064451 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1019531318-1296064451, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:16:16 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac" returned: 0 in 0.397s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:16 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac is being set with open permissions: ugo+rw Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Created reservations ['113f5f05-b33f-420b-a37d-82ca81015020', '6ab3deef-20ab-47ba-ab9d-54efb3625736', '6f9c19b0-b348-4abe-a8fd-dd3b6f52c0d0', '1b499473-7d8d-429a-8bf5-fa4c87614199'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:16 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac Sep 11 23:16:16 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:16 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:16 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:16 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac" returned: 0 in 0.350s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:16 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.info Sep 11 23:16:16 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:16 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.341s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Deleted volume successfully. Sep 11 23:16:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a9a4b58-bd20-4441-ae7a-71286928a77b tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-2c0c724b-2123-4a63-8545-75c877574909-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:17 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.info" returned: 0 in 0.305s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:17 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.info is being set with open permissions: ugo+rw Sep 11 23:16:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:17 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.info Sep 11 23:16:17 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:17 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.info" returned: 0 in 0.257s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.495s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:17 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-91544092-6953-48c2-a6d1-16ee732629ca tempest-VolumeDependencyTests-1320794160 None] Create snapshot completed successfully Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Flow 'volume_create_manager' (b27b7e52-89b7-48a0-93c1-b9145968492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f8e87e-ec0d-4322-bdee-cf56caa5cf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f8e87e-ec0d-4322-bdee-cf56caa5cf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1850812587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d4e1ed-2ee7-43fb-a971-083a8d434319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877b27c7a1e24b57a94d077d22ffb8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46707ac1-2424-438e-ab16-e2920e437cac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:19Z,use_quota=True,user_id='630aed13a9b541dbb1d74688f01ff5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbcf949-ffff-4ab5-82a9-5f3299f2af97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcbcf949-ffff-4ab5-82a9-5f3299f2af97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d37fccb-7d17-43ec-a4dd-abdcf81f9563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d37fccb-7d17-43ec-a4dd-abdcf81f9563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2d4e1ed-2ee7-43fb-a971-083a8d434319', 'volume_name': 'volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319', 'volume_size': 1, 'snapshot_id': '46707ac1-2424-438e-ab16-e2920e437cac'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ca3112-06f7-4b87-a036-9cde3e0c3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ca3112-06f7-4b87-a036-9cde3e0c3628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb7b26-de0c-46f4-9bae-0021189df38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:18 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Volume d2d4e1ed-2ee7-43fb-a971-083a8d434319: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319', 'volume_size': 1, 'snapshot_id': '46707ac1-2424-438e-ab16-e2920e437cac'} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-quobyte-46707ac1-2424-438e-ab16-e2920e437cac-d2d4e1ed-2ee7-43fb-a971-083a8d434319" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-46707ac1-2424-438e-ab16-e2920e437cac-d2d4e1ed-2ee7-43fb-a971-083a8d434319" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Creating volume d2d4e1ed-2ee7-43fb-a971-083a8d434319 from snapshot 46707ac1-2424-438e-ab16-e2920e437cac {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-quobyte-d2d4e1ed-2ee7-43fb-a971-083a8d434319" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-d2d4e1ed-2ee7-43fb-a971-083a8d434319" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] snapshot: 46707ac1-2424-438e-ab16-e2920e437cac, volume: d2d4e1ed-2ee7-43fb-a971-083a8d434319, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb258c7-5037-40e0-9ea2-a5465469b600]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:18 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac Sep 11 23:16:18 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:19 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac" returned: 0 in 0.435s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[614d423c-c8f3-433d-8a36-68fa090fb2cf]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:19 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 Sep 11 23:16:19 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:19 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-bddf0ef1-9ac3-4b44-aa61-1731df12d405 req-d51d723d-1e74-4e7e-afdb-e1b2d78ba58c tempest-TestInstancesWithCinderVolumes-338863730 None] Terminate volume connection completed successfully. Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-bddf0ef1-9ac3-4b44-aa61-1731df12d405 req-d51d723d-1e74-4e7e-afdb-e1b2d78ba58c tempest-TestInstancesWithCinderVolumes-338863730 None] Deleting attachment 0f678400-9ff2-4c33-92fa-f490bb17c6ae. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:16:19 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" returned: 0 in 0.431s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:16:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:19 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 Sep 11 23:16:19 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "cinder-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "cinder-quobyte-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-quobyte-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7" acquired by "delete_volume" :: waited 0.051s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:20 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c02491-f75b-4de0-b07f-10d0da28368f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:21 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 Sep 11 23:16:21 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:22 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7" returned: 0 in 1.180s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Flow 'volume_create_manager' (fadb86cf-786f-4ef0-a43a-9a55d52d0294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:22 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7 Sep 11 23:16:22 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd298d7e-e8e6-4e7d-968f-1abd98ff74de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd298d7e-e8e6-4e7d-968f-1abd98ff74de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd88943e-9e28-4282-aca7-958606088399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f260e451722e43a6973868526d373a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:22Z,use_quota=True,user_id='5171cb7f8cc04ae88433a0e169ac5bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58a1f842-9242-4d49-a94e-1be57300e075),volume_type_id=58a1f842-9242-4d49-a94e-1be57300e075)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb043f9a-dbbf-42c3-a703-744981b2c915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb043f9a-dbbf-42c3-a703-744981b2c915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01dcfc85-2658-4b51-9628-368034e4b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:16:22 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7" returned: 0 in 0.562s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-quobyte-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7" released by "delete_volume" :: held 1.875s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:22 devstack cinder-volume[88026]: WARNING cinder.quota [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-635618444-18831461 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-635618444-18831461, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:16:22 devstack cinder-volume[88026]: WARNING cinder.quota [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-635618444-18831461 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-635618444-18831461, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:16:22 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Created reservations ['f806e608-1e1b-4fd7-9a2c-fae439cf4a9f', '10ddb943-0eb4-4738-a590-783115598c43', '067f2bc5-793c-45c2-9ac9-b206df8d9bff', '35b805e0-cc33-47a3-bdc8-5882b9e1e310'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:23 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:23 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01dcfc85-2658-4b51-9628-368034e4b59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd88943e-9e28-4282-aca7-958606088399', 'volume_name': 'volume-cd88943e-9e28-4282-aca7-958606088399', 'volume_size': 1, 'image_id': '3dea9d69-f042-4e6b-b53c-12307aef5095', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3dea9d69-f042-4e6b-b53c-12307aef5095', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '366000e59a921564c1c5d39320a033d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f260e451722e43a6973868526d373a8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17dca0e674c63b520cd26420e39f040f5247849ec5bf4c858e2c032257135da29217c46d82e45b2da54eec9b1e6b329c62d796a57d60f4b239aa3b6605376393', 'id': '3dea9d69-f042-4e6b-b53c-12307aef5095', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3dea9d69-f042-4e6b-b53c-12307aef5095/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6bc3e1-886c-4686-bf5c-754afaa01ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6bc3e1-886c-4686-bf5c-754afaa01ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f38cd3a-6880-49b8-83d6-ef4498a0c540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:23 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Volume cd88943e-9e28-4282-aca7-958606088399: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd88943e-9e28-4282-aca7-958606088399', 'volume_size': 1, 'image_id': '3dea9d69-f042-4e6b-b53c-12307aef5095', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3dea9d69-f042-4e6b-b53c-12307aef5095', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '366000e59a921564c1c5d39320a033d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f260e451722e43a6973868526d373a8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17dca0e674c63b520cd26420e39f040f5247849ec5bf4c858e2c032257135da29217c46d82e45b2da54eec9b1e6b329c62d796a57d60f4b239aa3b6605376393', 'id': '3dea9d69-f042-4e6b-b53c-12307aef5095', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3dea9d69-f042-4e6b-b53c-12307aef5095/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Trying to clone cd88943e-9e28-4282-aca7-958606088399 from image 3dea9d69-f042-4e6b-b53c-12307aef5095 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3dea9d69-f042-4e6b-b53c-12307aef5095', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:16:23 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:16:23 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Image download 0.00 MB at 0.00 MB/s Sep 11 23:16:24 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bef1b3-f440-46b3-a2db-8fa9ca555d7c]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:24 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 1.152s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:24 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Deleted volume successfully. Sep 11 23:16:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-10019589-805e-4952-a02e-eef2fb8b54da tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-6f4d3dca-3efa-49e7-bcb4-e47bebdf3fc7-delete_volume" released by "delete_volume" :: held 3.743s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:24 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD Sep 11 23:16:24 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:25 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD" returned: 0 in 0.938s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:25 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD Sep 11 23:16:25 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:26 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319" returned: 0 in 6.287s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:16:26 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Converted 1024.00 MB image at 162.81 MB/s Sep 11 23:16:26 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 is being set with open permissions: ugo+rw Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:26 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 Sep 11 23:16:26 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:26 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD" returned: 1 in 1.166s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Temporary image 3dea9d69-f042-4e6b-b53c-12307aef5095 is fetched for user 5171cb7f8cc04ae88433a0e169ac5bee. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[87af4c4d-5c56-4aef-9229-2ff3424780f0]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:26 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319" returned: 0 in 0.291s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-d2d4e1ed-2ee7-43fb-a971-083a8d434319" released by "_copy_volume_from_snapshot" :: held 7.538s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:26 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD Sep 11 23:16:26 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-46707ac1-2424-438e-ab16-e2920e437cac-d2d4e1ed-2ee7-43fb-a971-083a8d434319" released by "_create_volume_from_snapshot" :: held 7.797s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.819s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:26 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:26 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD Sep 11 23:16:26 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb7b26-de0c-46f4-9bae-0021189df38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319', 'volume_size': 1, 'snapshot_id': '46707ac1-2424-438e-ab16-e2920e437cac'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2a9912-bbbb-48de-ba25-6de77b59bb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:26 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Volume volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 (d2d4e1ed-2ee7-43fb-a971-083a8d434319): created successfully Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2a9912-bbbb-48de-ba25-6de77b59bb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Flow 'volume_create_manager' (b27b7e52-89b7-48a0-93c1-b9145968492f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-75bf0c33-51ab-468d-ab5b-3f6a16a91ac7 tempest-VolumeDependencyTests-1320794160 None] Created volume successfully. Sep 11 23:16:27 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd88943e-9e28-4282-aca7-958606088399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f260e451722e43a6973868526d373a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:22Z,use_quota=True,user_id='5171cb7f8cc04ae88433a0e169ac5bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58a1f842-9242-4d49-a94e-1be57300e075),volume_type_id=58a1f842-9242-4d49-a94e-1be57300e075)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Creating volume cd88943e-9e28-4282-aca7-958606088399 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:27 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:27 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 1073741824 Sep 11 23:16:27 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-46707ac1-2424-438e-ab16-e2920e437cac-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-46707ac1-2424-438e-ab16-e2920e437cac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-quobyte-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-quobyte-46707ac1-2424-438e-ab16-e2920e437cac" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-46707ac1-2424-438e-ab16-e2920e437cac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Deleting offline snapshot 46707ac1-2424-438e-ab16-e2920e437cac of volume 84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:16:27 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] snapshot_file for this snap is: volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 1073741824" returned: 0 in 0.775s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b862dda-bde4-4f41-9bee-38f26226f8ea]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:27 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 Sep 11 23:16:27 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:28 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac Sep 11 23:16:28 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:28 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399" returned: 0 in 0.304s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Attempting download of 3dea9d69-f042-4e6b-b53c-12307aef5095 ((None, [{'url': 'file:///opt/stack/data/glance/images/3dea9d69-f042-4e6b-b53c-12307aef5095', 'metadata': {}}])) to volume cd88943e-9e28-4282-aca7-958606088399. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:16:28 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[665c29c0-7000-4592-b924-3377e654acc2]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3dea9d69-f042-4e6b-b53c-12307aef5095_5gylbwvm {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac" returned: 0 in 0.507s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de07cba-5406-442a-aac9-f588a4376d3e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:28 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3dea9d69-f042-4e6b-b53c-12307aef5095_5gylbwvm Sep 11 23:16:28 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:28 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 Sep 11 23:16:28 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:28 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3dea9d69-f042-4e6b-b53c-12307aef5095_5gylbwvm" returned: 0 in 0.482s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3dea9d69-f042-4e6b-b53c-12307aef5095_5gylbwvm {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:29 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3dea9d69-f042-4e6b-b53c-12307aef5095_5gylbwvm Sep 11 23:16:29 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=108,cinder:INSERT=33,cinder:UPDATE=122,cinder:DELETE=10 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=120,cinder:UPDATE=134,cinder:INSERT=26,cinder:DELETE=10 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:16:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-c3d7f715-f8ee-4c56-b716-824f76411e3f req-614add22-b341-44a1-bef4-aa68fba72389 tempest-TestInstancesWithCinderVolumes-338863730 None] Terminate volume connection completed successfully. Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-c3d7f715-f8ee-4c56-b716-824f76411e3f req-614add22-b341-44a1-bef4-aa68fba72389 tempest-TestInstancesWithCinderVolumes-338863730 None] Deleting attachment 1a269889-b703-46d3-893a-de7e69b3597c. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:16:29 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" returned: 0 in 0.743s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:29 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac Sep 11 23:16:29 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:29 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3dea9d69-f042-4e6b-b53c-12307aef5095_5gylbwvm" returned: 1 in 0.383s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3dea9d69-f042-4e6b-b53c-12307aef5095_5gylbwvm' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3952f4a-da34-4452-9c19-6e675e83e6cc]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:29 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD Sep 11 23:16:29 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:29 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac" returned: 0 in 0.429s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:29 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:29 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac Sep 11 23:16:29 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:29 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD Sep 11 23:16:29 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "cinder-3fd8c407-3f16-46a0-b0b1-8ee00c229c13-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-3fd8c407-3f16-46a0-b0b1-8ee00c229c13-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:29 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47.46707ac1-2424-438e-ab16-e2920e437cac" returned: 0 in 0.288s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-46707ac1-2424-438e-ab16-e2920e437cac" released by "_delete_snapshot" :: held 2.141s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" released by "delete_snapshot" :: held 2.166s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "cinder-quobyte-3fd8c407-3f16-46a0-b0b1-8ee00c229c13" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-quobyte-3fd8c407-3f16-46a0-b0b1-8ee00c229c13" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:30 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[037f9cff-b205-4995-9391-e5a72ea744e1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] 3dea9d69-f042-4e6b-b53c-12307aef5095 was raw, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:30 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 Sep 11 23:16:30 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Created reservations ['87833a4a-c59a-4993-a109-5275b4a79aae', 'c0a95819-a8cf-466d-b929-a9ea77191f68', '52ec5084-5a42-4134-a965-ac4e862ae809', '5c0b73be-5023-40b0-b9a9-cd7cf54ecd2e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:30 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 Sep 11 23:16:30 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Delete snapshot completed successfully. Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-9afcd3d7-ffa4-4492-8ffc-e1eb7e1a58f1 tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-46707ac1-2424-438e-ab16-e2920e437cac-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:30 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:30 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13 Sep 11 23:16:30 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:30 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399" returned: 0 in 0.485s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3dea9d69-f042-4e6b-b53c-12307aef5095_pflunb4fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:16:30 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:30 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 1G Sep 11 23:16:30 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:30 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3fd8c407-3f16-46a0-b0b1-8ee00c229c13" returned: 0 in 0.256s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-quobyte-3fd8c407-3f16-46a0-b0b1-8ee00c229c13" released by "delete_volume" :: held 0.715s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:30 devstack cinder-volume[88026]: WARNING cinder.quota [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1218578584-876677110 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1218578584-876677110, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:16:30 devstack cinder-volume[88026]: WARNING cinder.quota [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1218578584-876677110 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1218578584-876677110, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Created reservations ['2ecea851-249d-4758-94a7-000ee76cabc5', 'ab2f0809-96be-4606-ab16-82dfb7ee4c8a', 'd253c4d9-1d03-4c67-980b-c840c58d3c0e', '812e4d21-8011-4fc8-96e3-4b9e3159a8d0'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:30 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:30 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:30 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 1G" returned: 0 in 0.376s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Downloaded image 3dea9d69-f042-4e6b-b53c-12307aef5095 ((None, [{'url': 'file:///opt/stack/data/glance/images/3dea9d69-f042-4e6b-b53c-12307aef5095', 'metadata': {}}])) to volume cd88943e-9e28-4282-aca7-958606088399 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Temporary image 3dea9d69-f042-4e6b-b53c-12307aef5095 for user 5171cb7f8cc04ae88433a0e169ac5bee is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Marking volume cd88943e-9e28-4282-aca7-958606088399 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Copying metadata from image 3dea9d69-f042-4e6b-b53c-12307aef5095 to cd88943e-9e28-4282-aca7-958606088399. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:16:30 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Creating volume glance metadata for volume cd88943e-9e28-4282-aca7-958606088399 backed by image 3dea9d69-f042-4e6b-b53c-12307aef5095 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3dea9d69-f042-4e6b-b53c-12307aef5095', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '366000e59a921564c1c5d39320a033d7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-84515aa5-6bfc-49e2-94f7-d94f6ebcab47-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f38cd3a-6880-49b8-83d6-ef4498a0c540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd88943e-9e28-4282-aca7-958606088399', 'volume_size': 1, 'image_id': '3dea9d69-f042-4e6b-b53c-12307aef5095', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3dea9d69-f042-4e6b-b53c-12307aef5095', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '366000e59a921564c1c5d39320a033d7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f260e451722e43a6973868526d373a8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17dca0e674c63b520cd26420e39f040f5247849ec5bf4c858e2c032257135da29217c46d82e45b2da54eec9b1e6b329c62d796a57d60f4b239aa3b6605376393', 'id': '3dea9d69-f042-4e6b-b53c-12307aef5095', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3dea9d69-f042-4e6b-b53c-12307aef5095/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ee8132-a7c2-4db9-b102-5a2b4adab52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-84515aa5-6bfc-49e2-94f7-d94f6ebcab47-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:31 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Volume volume-cd88943e-9e28-4282-aca7-958606088399 (cd88943e-9e28-4282-aca7-958606088399): created successfully Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ee8132-a7c2-4db9-b102-5a2b4adab52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Flow 'volume_create_manager' (fadb86cf-786f-4ef0-a43a-9a55d52d0294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:31 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-80789e53-9751-4598-a9d6-491933faddac tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Created volume successfully. Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-quobyte-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:31 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.324s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:31 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Deleted volume successfully. Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[325de9af-4e45-42c0-9d98-0d5b6c2b4844]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-84ddf6de-d4a1-4398-9760-77b894e3a938 tempest-TestInstancesWithCinderVolumes-338863730 None] Lock "cinder-3fd8c407-3f16-46a0-b0b1-8ee00c229c13-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:31 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 Sep 11 23:16:31 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:31 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:31 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47 Sep 11 23:16:31 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:31 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" returned: 0 in 0.284s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-84515aa5-6bfc-49e2-94f7-d94f6ebcab47" released by "delete_volume" :: held 0.779s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Acquiring lock "cinder-cd88943e-9e28-4282-aca7-958606088399-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Created reservations ['89507e4a-5a4b-437f-859a-5efdc6f65610', '3b7944c4-97d7-4209-b6a8-e857e5eec699', '7924c149-ea40-47e5-b947-b541b7b736ac', '3054d323-b523-4340-a78d-f3b87e948fb0'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "cinder-cd88943e-9e28-4282-aca7-958606088399-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Acquiring lock "cinder-quobyte-cd88943e-9e28-4282-aca7-958606088399" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "cinder-quobyte-cd88943e-9e28-4282-aca7-958606088399" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5076e93-a8ee-4c35-b793-8094b1f2a3de]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:32 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:32 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-d2d4e1ed-2ee7-43fb-a971-083a8d434319-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-d2d4e1ed-2ee7-43fb-a971-083a8d434319-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:32 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 Sep 11 23:16:32 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "cinder-quobyte-d2d4e1ed-2ee7-43fb-a971-083a8d434319" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-d2d4e1ed-2ee7-43fb-a971-083a8d434319" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[434543a8-054e-41d1-b25f-7db42501b5a3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:32 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 Sep 11 23:16:32 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:32 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.359s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:32 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Deleted volume successfully. Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5a93c161-9aa2-4223-be5c-ccb5bb2484ce tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-84515aa5-6bfc-49e2-94f7-d94f6ebcab47-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:32 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399" returned: 0 in 0.510s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:32 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399 Sep 11 23:16:32 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:32 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319" returned: 0 in 0.505s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:32 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319 Sep 11 23:16:32 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:33 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cd88943e-9e28-4282-aca7-958606088399" returned: 0 in 0.342s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "cinder-quobyte-cd88943e-9e28-4282-aca7-958606088399" released by "delete_volume" :: held 0.906s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:33 devstack cinder-volume[88026]: WARNING cinder.quota [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:16:33 devstack cinder-volume[88026]: WARNING cinder.quota [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Created reservations ['9df4dd63-ab2b-4ae4-8352-3ba34ff14026', '55e9235d-8fdd-4b73-914f-0c0d2362aecc', 'e2a608a1-f09c-42f8-8868-9f9c2e196db6', 'a61ab48e-26fd-4aee-b2b3-5823faec6384'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:33 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d2d4e1ed-2ee7-43fb-a971-083a8d434319" returned: 0 in 0.288s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:33 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:33 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-quobyte-d2d4e1ed-2ee7-43fb-a971-083a8d434319" released by "delete_volume" :: held 0.865s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Created reservations ['25238193-ee37-4f2b-96c3-c08ab8a170f4', '0a28b63a-7e64-47bf-88fd-4ad87fabe7d1', '6e27b787-4601-4ea2-bfc4-3bd883bd1f65', 'fad25f73-2b04-4fe8-bceb-ef4d2c384355'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:33 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:33 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:33 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.443s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Deleted volume successfully. Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-76199106-7fde-412a-9bbb-313e74a02dba tempest-VolumeAndVolumeTypeFromImageTest-379226752 None] Lock "cinder-cd88943e-9e28-4282-aca7-958606088399-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:33 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.315s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Deleted volume successfully. Sep 11 23:16:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fbfaeea0-1b1a-4b32-8e65-27934a5709da tempest-VolumeDependencyTests-1320794160 None] Lock "cinder-d2d4e1ed-2ee7-43fb-a971-083a8d434319-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (ec2537a0-0a8f-4d5e-915c-2369bf3ef755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ebafb5-6079-489c-ace2-00687e265a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ebafb5-6079-489c-ace2-00687e265a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-283489839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca97377-9fbe-49eb-b26f-076e5a4eae3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:40Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698ca712-a005-4f6a-811b-35a9796ce789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698ca712-a005-4f6a-811b-35a9796ce789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e44d825-8297-4831-a884-958ea55b953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e44d825-8297-4831-a884-958ea55b953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca97377-9fbe-49eb-b26f-076e5a4eae3d', 'volume_name': 'volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4085778-6079-4b99-9f34-90b5dbf9e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4085778-6079-4b99-9f34-90b5dbf9e02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459223c7-5349-4b5b-8803-089653e27bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:39 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Volume cca97377-9fbe-49eb-b26f-076e5a4eae3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d', 'volume_size': 1} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-283489839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca97377-9fbe-49eb-b26f-076e5a4eae3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:40Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Creating volume cca97377-9fbe-49eb-b26f-076e5a4eae3d {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:39 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:39 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d 1073741824 Sep 11 23:16:39 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (dd673c83-ea2b-4731-9a59-3c45fa32549b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99492be-19d4-4a63-95f5-853a51e6bbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99492be-19d4-4a63-95f5-853a51e6bbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-508849880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d32349-a84a-41c8-9f5c-b978131bbe03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:40Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cc9c1e-19f4-4dda-b83a-c826383398ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cc9c1e-19f4-4dda-b83a-c826383398ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce32fe6-3550-4223-8615-bdc22ea63d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce32fe6-3550-4223-8615-bdc22ea63d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d32349-a84a-41c8-9f5c-b978131bbe03', 'volume_name': 'volume-c8d32349-a84a-41c8-9f5c-b978131bbe03', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ead2f01-3ef6-417f-9585-b9da84f1a0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ead2f01-3ef6-417f-9585-b9da84f1a0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65783240-63fe-49c2-9210-fb40cd4237bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Volume c8d32349-a84a-41c8-9f5c-b978131bbe03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d32349-a84a-41c8-9f5c-b978131bbe03', 'volume_size': 1} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:40 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d 1073741824" returned: 0 in 0.837s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (59c47201-e7b0-41f2-bc10-b9032d8645c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b731cbdf-cfd8-4cd0-8ce4-5d40be29af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b731cbdf-cfd8-4cd0-8ce4-5d40be29af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-508223235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa61ec8-80df-4610-9df8-92134cc0e0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:41Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606e180c-fec3-431c-912f-65f5772d8563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606e180c-fec3-431c-912f-65f5772d8563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d3d09e-691f-41f7-8523-ac1655f30ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d3d09e-691f-41f7-8523-ac1655f30ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa61ec8-80df-4610-9df8-92134cc0e0c0', 'volume_name': 'volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:40 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9444b8ff-7517-466a-ad20-8b6a82f004f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9444b8ff-7517-466a-ad20-8b6a82f004f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4002285-a7ca-4e3b-95af-2639c6521873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:40 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Volume 9aa61ec8-80df-4610-9df8-92134cc0e0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0', 'volume_size': 1} Sep 11 23:16:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:41 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-508849880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d32349-a84a-41c8-9f5c-b978131bbe03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:40Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Creating volume c8d32349-a84a-41c8-9f5c-b978131bbe03 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:41 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459223c7-5349-4b5b-8803-089653e27bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870bb2bd-30cd-4e50-8c87-b3dd712bbccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 1073741824 Sep 11 23:16:41 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Volume volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d (cca97377-9fbe-49eb-b26f-076e5a4eae3d): created successfully Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870bb2bd-30cd-4e50-8c87-b3dd712bbccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (ec2537a0-0a8f-4d5e-915c-2369bf3ef755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:41 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-31cb71ba-617e-4ae4-9926-1a52f84d73c8 tempest-CreateVolumesFromImageTest-1798708412 None] Created volume successfully. Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (8e5d8dff-f98d-4e0b-a72a-a90af7d2c5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564f598f-4236-4dd2-886a-8a40fb735a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564f598f-4236-4dd2-886a-8a40fb735a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-921812368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de34b00-03d2-4aef-834d-b101e075b58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:41Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78642544-b7e0-4b4d-9e38-4b9cef67f717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78642544-b7e0-4b4d-9e38-4b9cef67f717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15fd40b-3201-45eb-bda4-7f03c70cdd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15fd40b-3201-45eb-bda4-7f03c70cdd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de34b00-03d2-4aef-834d-b101e075b58e', 'volume_name': 'volume-3de34b00-03d2-4aef-834d-b101e075b58e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c207fe49-8cf5-4c9c-ab36-c73b99d85e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c207fe49-8cf5-4c9c-ab36-c73b99d85e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a4d07b-1b20-4b75-a14d-202864585aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Volume 3de34b00-03d2-4aef-834d-b101e075b58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de34b00-03d2-4aef-834d-b101e075b58e', 'volume_size': 1} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Flow 'volume_create_manager' (566d5b0a-a1d2-4d2c-81e4-1ec72dbe7879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5aefe1f-6677-4074-8a1e-db0ce57d6acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5aefe1f-6677-4074-8a1e-db0ce57d6acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e2251a-e3c8-4484-b357-4c33facc8924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d57adc9d584fd1b7e288fd8c643add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:41Z,use_quota=True,user_id='2c7f2b1cdb5449e4883cb1d90edb708c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be013075-e4c9-436b-a77d-1654754bf3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be013075-e4c9-436b-a77d-1654754bf3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67dee4f3-87e2-4b63-b239-0c425dc0681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (f89cc325-f507-4f08-8c87-4a7e578278d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa10b12a-bd1a-49be-afac-5e30954336c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa10b12a-bd1a-49be-afac-5e30954336c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270258527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:42Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1da8440-d336-4199-8609-69226723f815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1da8440-d336-4199-8609-69226723f815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcee052c-6151-40f6-af0a-a5caf4e38ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcee052c-6151-40f6-af0a-a5caf4e38ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5', 'volume_name': 'volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64fb6f1-619f-4966-93fe-032db4b369db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64fb6f1-619f-4966-93fe-032db4b369db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d977fc-f594-4fb0-83e2-178f0df0ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Volume 5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5', 'volume_size': 1} Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:41 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 1073741824" returned: 0 in 0.700s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:42 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 Sep 11 23:16:42 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67dee4f3-87e2-4b63-b239-0c425dc0681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59e2251a-e3c8-4484-b357-4c33facc8924', 'volume_name': 'volume-59e2251a-e3c8-4484-b357-4c33facc8924', 'volume_size': 1, 'image_id': '9b85e867-4bb3-46ec-940a-f21e91756677', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b85e867-4bb3-46ec-940a-f21e91756677', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e964bbdcb42443b2fac674cbb9b6df6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14d57adc9d584fd1b7e288fd8c643add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '199a21f447606a3c20c24bb2018fac561a3be14321b559b2af32b7cef715978d78fd2886c7d82d5e0f8c3392f5b08c75cb8ef73f5e3581fc176edbb88f29b146', 'id': '9b85e867-4bb3-46ec-940a-f21e91756677', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b85e867-4bb3-46ec-940a-f21e91756677/file', 'properties': {}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0843625d-be5d-4753-b4eb-9189d0b6ace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0843625d-be5d-4753-b4eb-9189d0b6ace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2519ee56-f355-4379-97ce-c07866ea2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Volume 59e2251a-e3c8-4484-b357-4c33facc8924: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59e2251a-e3c8-4484-b357-4c33facc8924', 'volume_size': 1, 'image_id': '9b85e867-4bb3-46ec-940a-f21e91756677', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b85e867-4bb3-46ec-940a-f21e91756677', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e964bbdcb42443b2fac674cbb9b6df6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14d57adc9d584fd1b7e288fd8c643add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '199a21f447606a3c20c24bb2018fac561a3be14321b559b2af32b7cef715978d78fd2886c7d82d5e0f8c3392f5b08c75cb8ef73f5e3581fc176edbb88f29b146', 'id': '9b85e867-4bb3-46ec-940a-f21e91756677', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b85e867-4bb3-46ec-940a-f21e91756677/file', 'properties': {}}, 'image_service': } Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Trying to clone 59e2251a-e3c8-4484-b357-4c33facc8924 from image 9b85e867-4bb3-46ec-940a-f21e91756677 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b85e867-4bb3-46ec-940a-f21e91756677', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:16:42 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Image download 0.00 MB at 0.00 MB/s Sep 11 23:16:42 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03" returned: 0 in 0.315s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-508223235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa61ec8-80df-4610-9df8-92134cc0e0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:41Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Creating volume 9aa61ec8-80df-4610-9df8-92134cc0e0c0 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:42 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65783240-63fe-49c2-9210-fb40cd4237bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d32349-a84a-41c8-9f5c-b978131bbe03', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d078c504-d9e4-4709-81a1-1bb4d801e12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:42 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 1073741824 Sep 11 23:16:42 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4167387d-856b-4c4b-9ec7-a52b856aa1bc]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Volume volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 (c8d32349-a84a-41c8-9f5c-b978131bbe03): created successfully Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d078c504-d9e4-4709-81a1-1bb4d801e12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (dd673c83-ea2b-4731-9a59-3c45fa32549b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c63883bd-320f-49ca-875f-72d64310b652 tempest-CreateVolumesFromImageTest-1798708412 None] Created volume successfully. Sep 11 23:16:42 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD Sep 11 23:16:42 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:42 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:42 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 1073741824" returned: 0 in 0.590s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:43 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD Sep 11 23:16:43 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:43 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 Sep 11 23:16:43 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:43 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:43 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0" returned: 0 in 0.316s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-921812368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de34b00-03d2-4aef-834d-b101e075b58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:41Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Creating volume 3de34b00-03d2-4aef-834d-b101e075b58e {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:43 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD" returned: 1 in 0.484s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Temporary image 9b85e867-4bb3-46ec-940a-f21e91756677 is fetched for user 2c7f2b1cdb5449e4883cb1d90edb708c. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:16:43 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e 1073741824 Sep 11 23:16:43 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4002285-a7ca-4e3b-95af-2639c6521873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61be3152-5a37-4793-b688-53025adaf542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Volume volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 (9aa61ec8-80df-4610-9df8-92134cc0e0c0): created successfully Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61be3152-5a37-4793-b688-53025adaf542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (59c47201-e7b0-41f2-bc10-b9032d8645c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:43 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-33d3d9f4-adf0-4492-8e44-8e3a2e92cce7 tempest-CreateVolumesFromImageTest-1798708412 None] Created volume successfully. Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aafd3c-09de-420d-8472-57b8517dcab6]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:43 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD Sep 11 23:16:43 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:43 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:43 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e 1073741824" returned: 0 in 0.534s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:43 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e Sep 11 23:16:43 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:44 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD Sep 11 23:16:44 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:44 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.367s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270258527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43984db86d314152adeffa3f516d5894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:42Z,use_quota=True,user_id='84b81838673d4fd6862cb01bf88b329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Creating volume 5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:44 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:44 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a4d07b-1b20-4b75-a14d-202864585aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de34b00-03d2-4aef-834d-b101e075b58e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:44 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 1073741824 Sep 11 23:16:44 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993be77d-d2c4-4ff4-ac4b-a72fbeae0ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD" returned: 1 in 0.409s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Volume volume-3de34b00-03d2-4aef-834d-b101e075b58e (3de34b00-03d2-4aef-834d-b101e075b58e): created successfully Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993be77d-d2c4-4ff4-ac4b-a72fbeae0ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (8e5d8dff-f98d-4e0b-a72a-a90af7d2c5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-19878b62-51ec-48cd-a4ec-2c88953d6545 tempest-CreateVolumesFromImageTest-1798708412 None] Created volume successfully. Sep 11 23:16:44 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 1073741824" returned: 0 in 0.493s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:44 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 Sep 11 23:16:44 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:45 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5" returned: 0 in 0.317s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e2251a-e3c8-4484-b357-4c33facc8924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d57adc9d584fd1b7e288fd8c643add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:41Z,use_quota=True,user_id='2c7f2b1cdb5449e4883cb1d90edb708c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Creating volume 59e2251a-e3c8-4484-b357-4c33facc8924 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:45 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d977fc-f594-4fb0-83e2-178f0df0ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507ffe30-4978-41aa-9550-a4e6a6d83149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:45 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 1073741824 Sep 11 23:16:45 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Volume volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 (5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5): created successfully Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507ffe30-4978-41aa-9550-a4e6a6d83149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Flow 'volume_create_manager' (f89cc325-f507-4f08-8c87-4a7e578278d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1a38e674-6107-4422-8be7-6feb5e476e3e tempest-CreateVolumesFromImageTest-1798708412 None] Created volume successfully. Sep 11 23:16:45 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 1073741824" returned: 0 in 0.509s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:45 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 Sep 11 23:16:45 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:45 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Attempting download of 9b85e867-4bb3-46ec-940a-f21e91756677 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b85e867-4bb3-46ec-940a-f21e91756677', 'metadata': {}}])) to volume 59e2251a-e3c8-4484-b357-4c33facc8924. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[363bb446-2714-4d6c-bd8c-b501dad6952a]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b85e867-4bb3-46ec-940a-f21e91756677_yk7_tjl9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:46 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b85e867-4bb3-46ec-940a-f21e91756677_yk7_tjl9 Sep 11 23:16:46 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-quobyte-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:46 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b85e867-4bb3-46ec-940a-f21e91756677_yk7_tjl9" returned: 0 in 0.383s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b85e867-4bb3-46ec-940a-f21e91756677_yk7_tjl9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37bd55f-c86d-4817-a854-ee13883f57b3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:46 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b85e867-4bb3-46ec-940a-f21e91756677_yk7_tjl9 Sep 11 23:16:46 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:46 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 Sep 11 23:16:46 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:46 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b85e867-4bb3-46ec-940a-f21e91756677_yk7_tjl9" returned: 1 in 0.398s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b85e867-4bb3-46ec-940a-f21e91756677_yk7_tjl9' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6734896e-b18f-4262-9d83-ddde976e0e74]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:46 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5" returned: 0 in 0.425s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:46 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5 Sep 11 23:16:46 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:46 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD Sep 11 23:16:46 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:47 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5" released by "delete_volume" :: held 0.771s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:47 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Created reservations ['cd7473cb-6e24-416e-8977-1c85d84b9b37', '62e5fb7e-4c58-4843-94aa-59f1c709327d', '95bad87e-7037-44a3-9a7a-c626eaf3d702', '8a60e89f-d33f-4bdd-9f8e-f59c64613c66'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:47 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD Sep 11 23:16:47 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:47 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:47 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-3de34b00-03d2-4aef-834d-b101e075b58e-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-3de34b00-03d2-4aef-834d-b101e075b58e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:47 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] 9b85e867-4bb3-46ec-940a-f21e91756677 was raw, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:47 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.335s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:47 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 Sep 11 23:16:47 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Deleted volume successfully. Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-quobyte-3de34b00-03d2-4aef-834d-b101e075b58e" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-525e1ad8-09b8-453c-9b76-c775c0779878 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-5edcd3e5-38ef-431e-ad1f-f8f74a17a8e5-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-3de34b00-03d2-4aef-834d-b101e075b58e" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdc81a2-6c67-4213-bd09-13b16479a32f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:47 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e Sep 11 23:16:47 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:48 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924" returned: 0 in 0.595s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b85e867-4bb3-46ec-940a-f21e91756677_ir0pyr98devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:16:48 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:48 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e" returned: 0 in 0.476s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:48 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 1G Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:48 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:48 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e Sep 11 23:16:48 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:48 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3de34b00-03d2-4aef-834d-b101e075b58e" returned: 0 in 0.258s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-3de34b00-03d2-4aef-834d-b101e075b58e" released by "delete_volume" :: held 0.779s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Created reservations ['157fb712-715d-4934-9a11-eeaac70e8d9f', 'b82b40df-7859-4d8e-89d5-304550e01a57', '717d08ee-efd1-4588-a244-403537fd5e05', '299cb6d6-6e3c-49fe-a1a2-cf7e0468cd10'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:48 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 1G" returned: 0 in 0.378s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Downloaded image 9b85e867-4bb3-46ec-940a-f21e91756677 ((None, [{'url': 'file:///opt/stack/data/glance/images/9b85e867-4bb3-46ec-940a-f21e91756677', 'metadata': {}}])) to volume 59e2251a-e3c8-4484-b357-4c33facc8924 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Temporary image 9b85e867-4bb3-46ec-940a-f21e91756677 for user 2c7f2b1cdb5449e4883cb1d90edb708c is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Marking volume 59e2251a-e3c8-4484-b357-4c33facc8924 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Copying metadata from image 9b85e867-4bb3-46ec-940a-f21e91756677 to 59e2251a-e3c8-4484-b357-4c33facc8924. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Creating volume glance metadata for volume 59e2251a-e3c8-4484-b357-4c33facc8924 backed by image 9b85e867-4bb3-46ec-940a-f21e91756677 with: {'image_id': '9b85e867-4bb3-46ec-940a-f21e91756677', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5e964bbdcb42443b2fac674cbb9b6df6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2519ee56-f355-4379-97ce-c07866ea2608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e2251a-e3c8-4484-b357-4c33facc8924', 'volume_size': 1, 'image_id': '9b85e867-4bb3-46ec-940a-f21e91756677', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b85e867-4bb3-46ec-940a-f21e91756677', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e964bbdcb42443b2fac674cbb9b6df6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '14d57adc9d584fd1b7e288fd8c643add', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '199a21f447606a3c20c24bb2018fac561a3be14321b559b2af32b7cef715978d78fd2886c7d82d5e0f8c3392f5b08c75cb8ef73f5e3581fc176edbb88f29b146', 'id': '9b85e867-4bb3-46ec-940a-f21e91756677', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b85e867-4bb3-46ec-940a-f21e91756677/file', 'properties': {}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:48 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:48 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83db0f7-200e-4e0d-b519-17891650c1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:48 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Volume volume-59e2251a-e3c8-4484-b357-4c33facc8924 (59e2251a-e3c8-4484-b357-4c33facc8924): created successfully Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83db0f7-200e-4e0d-b519-17891650c1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Flow 'volume_create_manager' (566d5b0a-a1d2-4d2c-81e4-1ec72dbe7879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-9aa61ec8-80df-4610-9df8-92134cc0e0c0-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-9aa61ec8-80df-4610-9df8-92134cc0e0c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-dc023fd8-f635-4640-a9b9-bd15b29d1c7a tempest-VolumeImageDependencyTests-1947332065 None] Created volume successfully. Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-quobyte-9aa61ec8-80df-4610-9df8-92134cc0e0c0" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-9aa61ec8-80df-4610-9df8-92134cc0e0c0" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c3d870-4301-41bb-b6de-59063677dcd0]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Acquiring lock "cinder-59e2251a-e3c8-4484-b357-4c33facc8924-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Lock "cinder-59e2251a-e3c8-4484-b357-4c33facc8924-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:48 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.342s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:48 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Deleted volume successfully. Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-75fb0546-6240-42c2-bff7-3291b8ff6bb6 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-3de34b00-03d2-4aef-834d-b101e075b58e-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Acquiring lock "cinder-quobyte-59e2251a-e3c8-4484-b357-4c33facc8924" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Lock "cinder-quobyte-59e2251a-e3c8-4484-b357-4c33facc8924" acquired by "delete_volume" :: waited 0.013s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:49 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 Sep 11 23:16:49 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[90280c35-b6a1-45c8-b986-7e3ba0f18cba]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:49 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 Sep 11 23:16:49 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0" returned: 0 in 0.515s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:49 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0 Sep 11 23:16:49 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924" returned: 0 in 0.397s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:49 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924 Sep 11 23:16:49 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9aa61ec8-80df-4610-9df8-92134cc0e0c0" returned: 0 in 0.264s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-9aa61ec8-80df-4610-9df8-92134cc0e0c0" released by "delete_volume" :: held 0.861s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Created reservations ['70852798-1860-4275-a8f2-165473759c99', '10cbb3c7-0edd-4af6-be53-fe14e45da4d2', '6e774bd5-4f85-4125-a081-235b67b2927a', '4bd78c23-daab-4c50-8699-cf4b7e8c5617'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:49 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-59e2251a-e3c8-4484-b357-4c33facc8924" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Lock "cinder-quobyte-59e2251a-e3c8-4484-b357-4c33facc8924" released by "delete_volume" :: held 0.712s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:49 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:49 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Created reservations ['fc7d0816-cef5-4412-b0e8-266845624114', '701dff53-ebdb-4825-80e4-0aee346019eb', '57857cd6-94e1-4daf-afd1-6430c3b3da6c', 'b5210093-958b-4e3a-8ca3-6682e75ca664'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-c8d32349-a84a-41c8-9f5c-b978131bbe03-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:50 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:50 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-c8d32349-a84a-41c8-9f5c-b978131bbe03-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-quobyte-c8d32349-a84a-41c8-9f5c-b978131bbe03" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-c8d32349-a84a-41c8-9f5c-b978131bbe03" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:50 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.374s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Deleted volume successfully. Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3bb22b-ffb9-4e3b-8645-de6fb3d0f296]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-668fa054-f85b-4b6e-bf1e-61ba61d6735e tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-9aa61ec8-80df-4610-9df8-92134cc0e0c0-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:50 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 Sep 11 23:16:50 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:50 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.414s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Deleted volume successfully. Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c7e926a8-f59f-4efa-a85b-585eee6c5d33 tempest-VolumeImageDependencyTests-1947332065 None] Lock "cinder-59e2251a-e3c8-4484-b357-4c33facc8924-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:50 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03" returned: 0 in 0.486s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:50 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03 Sep 11 23:16:50 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:50 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c8d32349-a84a-41c8-9f5c-b978131bbe03" returned: 0 in 0.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-c8d32349-a84a-41c8-9f5c-b978131bbe03" released by "delete_volume" :: held 0.822s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Created reservations ['4e83bdf4-1e10-4db1-8ac4-c8c8841caad6', '83780aae-bb11-4100-8254-12650a3442a1', '150b1798-2620-4b08-a2ae-ee9cfb194253', '18ac300d-79dd-4dc7-9c18-38cba49146c9'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-cca97377-9fbe-49eb-b26f-076e5a4eae3d-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-cca97377-9fbe-49eb-b26f-076e5a4eae3d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:51 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:51 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "cinder-quobyte-cca97377-9fbe-49eb-b26f-076e5a4eae3d" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-cca97377-9fbe-49eb-b26f-076e5a4eae3d" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf756da-1af3-4d3d-b8a2-9aeaab51c0fe]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:51 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d Sep 11 23:16:51 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:51 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.374s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Deleted volume successfully. Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-39335e61-bd61-443f-97a1-7f179bcd323d tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-c8d32349-a84a-41c8-9f5c-b978131bbe03-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:51 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d" returned: 0 in 0.604s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:51 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d Sep 11 23:16:51 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:52 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cca97377-9fbe-49eb-b26f-076e5a4eae3d" returned: 0 in 0.305s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-quobyte-cca97377-9fbe-49eb-b26f-076e5a4eae3d" released by "delete_volume" :: held 0.970s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Created reservations ['ba2c18bc-8603-41a0-b12f-9d7b6401ff5e', 'e0abd1a6-a7f4-4b52-aad2-65c8eb16480f', 'aca977db-1448-4db5-b0e0-c81fd340b4fc', 'cf53f216-e66b-49d5-9a5c-517a29782847'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:52 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:52 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:52 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.298s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Deleted volume successfully. Sep 11 23:16:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-43e78438-5cf3-4a23-99b8-c87ed1d1ff55 tempest-CreateVolumesFromImageTest-1798708412 None] Lock "cinder-cca97377-9fbe-49eb-b26f-076e5a4eae3d-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Flow 'volume_create_manager' (e2ed6e65-0504-448a-a315-9fba8a5d0426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fdec4b-2c92-4d3d-8085-c85896d4aec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fdec4b-2c92-4d3d-8085-c85896d4aec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180232414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d92d20-d477-429b-b160-cc49496ddf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68f33652804bd6a7fd85e2ab0911d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:55Z,use_quota=True,user_id='840a71e7eeba4ea8bb57abc34b7cd224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fa21fe-510a-4b72-9f19-ecae8d6d1860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fa21fe-510a-4b72-9f19-ecae8d6d1860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d96f36-12f7-41ee-81aa-af0e63861094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d96f36-12f7-41ee-81aa-af0e63861094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d92d20-d477-429b-b160-cc49496ddf55', 'volume_name': 'volume-94d92d20-d477-429b-b160-cc49496ddf55', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3627ab-72a0-4a2c-9ece-79a496c12528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3627ab-72a0-4a2c-9ece-79a496c12528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14037a7-1aff-42e1-b11a-5f67a13947f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:55 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Volume 94d92d20-d477-429b-b160-cc49496ddf55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d92d20-d477-429b-b160-cc49496ddf55', 'volume_size': 1} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180232414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d92d20-d477-429b-b160-cc49496ddf55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68f33652804bd6a7fd85e2ab0911d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:55Z,use_quota=True,user_id='840a71e7eeba4ea8bb57abc34b7cd224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Creating volume 94d92d20-d477-429b-b160-cc49496ddf55 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:55 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:55 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 1073741824 Sep 11 23:16:55 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:56 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 1073741824" returned: 0 in 0.608s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:56 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 Sep 11 23:16:56 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:56 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55" returned: 0 in 0.314s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14037a7-1aff-42e1-b11a-5f67a13947f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d92d20-d477-429b-b160-cc49496ddf55', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5dcee2-ee98-40f9-9de0-30cb578c381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:56 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Volume volume-94d92d20-d477-429b-b160-cc49496ddf55 (94d92d20-d477-429b-b160-cc49496ddf55): created successfully Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5dcee2-ee98-40f9-9de0-30cb578c381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Flow 'volume_create_manager' (e2ed6e65-0504-448a-a315-9fba8a5d0426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8a44d81a-3a9a-4655-8b57-edfa8a904aca tempest-ProjectReaderTests-1887000063 None] Created volume successfully. Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Flow 'volume_create_manager' (32a70d4e-b23c-4064-a5c2-9cfd7c100e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c56463d-97ad-42cc-be6b-dd1416f8d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c56463d-97ad-42cc-be6b-dd1416f8d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5145f19f-df1b-4e83-bfe9-c6db8481b379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93088901b4e5e8abc0470bf759eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:57Z,use_quota=True,user_id='1e7b19b4b8014641a750046ed2c4613d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce04c86-11b4-4853-b1c0-1f2e397b7e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce04c86-11b4-4853-b1c0-1f2e397b7e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8e5231-037f-4231-bdb0-c334bfe5793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8e5231-037f-4231-bdb0-c334bfe5793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5145f19f-df1b-4e83-bfe9-c6db8481b379', 'volume_name': 'volume-5145f19f-df1b-4e83-bfe9-c6db8481b379', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26df2de8-8a58-4636-b2fa-35052ccbf6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26df2de8-8a58-4636-b2fa-35052ccbf6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c59053-e0a9-4f65-9c13-bb33a68a6f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:57 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Volume 5145f19f-df1b-4e83-bfe9-c6db8481b379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5145f19f-df1b-4e83-bfe9-c6db8481b379', 'volume_size': 1} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5145f19f-df1b-4e83-bfe9-c6db8481b379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93088901b4e5e8abc0470bf759eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:57Z,use_quota=True,user_id='1e7b19b4b8014641a750046ed2c4613d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Creating volume 5145f19f-df1b-4e83-bfe9-c6db8481b379 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:57 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:57 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 1073741824 Sep 11 23:16:57 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:57 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 1073741824" returned: 0 in 0.567s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:57 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 Sep 11 23:16:57 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "cinder-94d92d20-d477-429b-b160-cc49496ddf55-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-94d92d20-d477-429b-b160-cc49496ddf55-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "cinder-quobyte-94d92d20-d477-429b-b160-cc49496ddf55" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:16:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-quobyte-94d92d20-d477-429b-b160-cc49496ddf55" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe75105-56ae-4ced-950b-c476235e9700]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:58 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379" returned: 0 in 0.356s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:58 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 Sep 11 23:16:58 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c59053-e0a9-4f65-9c13-bb33a68a6f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5145f19f-df1b-4e83-bfe9-c6db8481b379', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f2e149-33d7-4159-8e20-1db6194dd97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:58 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Volume volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 (5145f19f-df1b-4e83-bfe9-c6db8481b379): created successfully Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f2e149-33d7-4159-8e20-1db6194dd97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Flow 'volume_create_manager' (32a70d4e-b23c-4064-a5c2-9cfd7c100e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0a040b62-59e6-44a7-b34f-ea47bbc86cf9 tempest-CinderUnicodeTest-1643167674 None] Created volume successfully. Sep 11 23:16:58 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55" returned: 0 in 0.409s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:58 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55 Sep 11 23:16:58 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:58 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-94d92d20-d477-429b-b160-cc49496ddf55" returned: 0 in 0.304s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-quobyte-94d92d20-d477-429b-b160-cc49496ddf55" released by "delete_volume" :: held 0.777s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Created reservations ['ce779b87-3c0c-459b-ac84-0b463ea374f5', 'f7e37fb6-126c-4edb-b6e8-b524b73f00b8', '5fbce05a-4355-4d9a-b055-a18ded9be5ff', '86d49fab-0a13-49ac-a1bf-c27d3f81ab1a'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:16:58 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:16:58 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:16:59 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.311s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:16:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Deleted volume successfully. Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a751e2e9-6108-4fdb-b3e4-3ad4ebab8005 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-94d92d20-d477-429b-b160-cc49496ddf55-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Flow 'volume_create_manager' (93203ddc-c280-478c-9463-16765d243eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a663b4-a672-4297-8651-6ed54497c8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a663b4-a672-4297-8651-6ed54497c8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1615555790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68f33652804bd6a7fd85e2ab0911d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:00Z,use_quota=True,user_id='840a71e7eeba4ea8bb57abc34b7cd224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bddd8a1-ddd8-4192-bded-ff5c07f597f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bddd8a1-ddd8-4192-bded-ff5c07f597f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a38fe4-810e-47cf-8793-996fa7d7c864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a38fe4-810e-47cf-8793-996fa7d7c864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e', 'volume_name': 'volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4508e85-3e9c-4276-98c6-98627c2084e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4508e85-3e9c-4276-98c6-98627c2084e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fdfa72-21c6-4d5f-90af-c90eae7806c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:16:59 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Volume 7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e', 'volume_size': 1} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1615555790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68f33652804bd6a7fd85e2ab0911d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:00Z,use_quota=True,user_id='840a71e7eeba4ea8bb57abc34b7cd224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Creating volume 7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:16:59 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:16:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:00 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e 1073741824 Sep 11 23:17:00 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Flow 'volume_create_manager' (67344fe5-da5b-4c49-a8a6-f2ab1fe32509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1754f330-9bcf-4f2d-89a7-f8e884e9661b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1754f330-9bcf-4f2d-89a7-f8e884e9661b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-957071823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf774d8-5caa-4225-b120-908d46d919b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93088901b4e5e8abc0470bf759eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:00Z,use_quota=True,user_id='1e7b19b4b8014641a750046ed2c4613d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5ef908-fd75-43ea-a5ed-918e461db1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5ef908-fd75-43ea-a5ed-918e461db1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a3d349-5b4f-4669-bcf0-a789f50b1dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a3d349-5b4f-4669-bcf0-a789f50b1dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf774d8-5caa-4225-b120-908d46d919b6', 'volume_name': 'volume-7bf774d8-5caa-4225-b120-908d46d919b6', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e81dd3-a7a1-41be-9ea0-e834403012e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e81dd3-a7a1-41be-9ea0-e834403012e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84f457e-b9f4-4298-b839-a13ea31b73f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:00 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Volume 7bf774d8-5caa-4225-b120-908d46d919b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf774d8-5caa-4225-b120-908d46d919b6', 'volume_size': 1} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:00 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e 1073741824" returned: 0 in 0.555s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:00 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e Sep 11 23:17:00 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:00 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-957071823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf774d8-5caa-4225-b120-908d46d919b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e93088901b4e5e8abc0470bf759eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:00Z,use_quota=True,user_id='1e7b19b4b8014641a750046ed2c4613d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Creating volume 7bf774d8-5caa-4225-b120-908d46d919b6 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:00 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fdfa72-21c6-4d5f-90af-c90eae7806c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:00 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 1073741824 Sep 11 23:17:00 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d075e639-c5f8-4153-b10f-91e79da4dda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:00 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Volume volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e (7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e): created successfully Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d075e639-c5f8-4153-b10f-91e79da4dda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Flow 'volume_create_manager' (93203ddc-c280-478c-9463-16765d243eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f98f6b43-ddc4-425a-95cf-00b49c9714ff tempest-ProjectReaderTests-1887000063 None] Created volume successfully. Sep 11 23:17:01 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 1073741824" returned: 0 in 0.460s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:01 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 Sep 11 23:17:01 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:01 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84f457e-b9f4-4298-b839-a13ea31b73f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf774d8-5caa-4225-b120-908d46d919b6', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9960e775-ff0e-491b-8589-bea0d504fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:01 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Volume volume-7bf774d8-5caa-4225-b120-908d46d919b6 (7bf774d8-5caa-4225-b120-908d46d919b6): created successfully Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9960e775-ff0e-491b-8589-bea0d504fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Flow 'volume_create_manager' (67344fe5-da5b-4c49-a8a6-f2ab1fe32509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f5b852a4-8573-4b9b-88c0-cdd993ae236c tempest-CinderUnicodeTest-1643167674 None] Created volume successfully. Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "cinder-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "cinder-quobyte-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-quobyte-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e46d3f8-787a-4b40-ab1c-8a4493fd3264]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:02 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e Sep 11 23:17:02 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:02 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:02 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e Sep 11 23:17:02 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Creating offline snapshot 87f86c27-866a-4cc9-82ae-fbe0a511bcdf of volume 7bf774d8-5caa-4225-b120-908d46d919b6 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[70039228-e9ca-4a2a-94a8-4e65504958df]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:02 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e" returned: 0 in 0.310s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-quobyte-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e" released by "delete_volume" :: held 0.830s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:02 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 Sep 11 23:17:02 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Created reservations ['6733a4df-a32c-492c-8856-c7884d3d5a08', '7401b018-ae62-41d8-a2c7-7c50799b9f4e', '7fca38f1-c441-4615-bb06-c1c00d976d05', 'c9e533b1-06a4-4d8e-a0a2-68bae66fbabf'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:02 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:02 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:03 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6" returned: 0 in 0.451s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:03 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf 1G Sep 11 23:17:03 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:03 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.288s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Deleted volume successfully. Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a388dcae-94b4-4253-95a7-2042e95e9b67 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-7f2b1981-8964-49a2-b52b-8ee2d7ca0b9e-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Flow 'volume_create_manager' (4fd1580e-7f0e-4766-b165-0b122b2be85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f4a5df-1a05-4d83-9069-078677ca6974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f4a5df-1a05-4d83-9069-078677ca6974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404938684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f49de67-4a19-4ca8-9e47-57664265fa49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68f33652804bd6a7fd85e2ab0911d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:04Z,use_quota=True,user_id='840a71e7eeba4ea8bb57abc34b7cd224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:03 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16955749-ecf2-4b88-8f31-4b65973681de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16955749-ecf2-4b88-8f31-4b65973681de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8d0a6e-4cf1-41d0-bccf-272b3130b87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8d0a6e-4cf1-41d0-bccf-272b3130b87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f49de67-4a19-4ca8-9e47-57664265fa49', 'volume_name': 'volume-4f49de67-4a19-4ca8-9e47-57664265fa49', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7da9707-9b61-4c5d-bb53-9bb79b93a1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7da9707-9b61-4c5d-bb53-9bb79b93a1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5240fb78-7af3-4d68-89f4-9a9bcd8e2e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:03 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Volume 4f49de67-4a19-4ca8-9e47-57664265fa49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f49de67-4a19-4ca8-9e47-57664265fa49', 'volume_size': 1} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf 1G" returned: 0 in 0.630s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf774d8-5caa-4225-b120-908d46d919b6 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:03 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf774d8-5caa-4225-b120-908d46d919b6 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf Sep 11 23:17:03 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:04 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf774d8-5caa-4225-b120-908d46d919b6 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf" returned: 0 in 0.335s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:04 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf is being set with open permissions: ugo+rw Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:04 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf Sep 11 23:17:04 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:04 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf" returned: 0 in 0.244s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:04 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.info Sep 11 23:17:04 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:04 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.info" returned: 0 in 0.296s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:04 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.info is being set with open permissions: ugo+rw Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:04 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.info Sep 11 23:17:04 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:04 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.info" returned: 0 in 0.255s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404938684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f49de67-4a19-4ca8-9e47-57664265fa49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68f33652804bd6a7fd85e2ab0911d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:04Z,use_quota=True,user_id='840a71e7eeba4ea8bb57abc34b7cd224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Creating volume 4f49de67-4a19-4ca8-9e47-57664265fa49 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:04 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:17:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:04 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 1073741824 Sep 11 23:17:04 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-504b44ad-4df9-4572-b3b4-df6784812065 tempest-CinderUnicodeTest-1643167674 None] Create snapshot completed successfully Sep 11 23:17:05 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 1073741824" returned: 0 in 0.425s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:05 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 Sep 11 23:17:05 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:05 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49" returned: 0 in 0.254s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5240fb78-7af3-4d68-89f4-9a9bcd8e2e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f49de67-4a19-4ca8-9e47-57664265fa49', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acedef4-cba7-4b97-914c-3fc389f1625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:05 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Volume volume-4f49de67-4a19-4ca8-9e47-57664265fa49 (4f49de67-4a19-4ca8-9e47-57664265fa49): created successfully Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acedef4-cba7-4b97-914c-3fc389f1625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Flow 'volume_create_manager' (4fd1580e-7f0e-4766-b165-0b122b2be85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:05 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-93eaa7b4-0444-4f10-8b49-6a81c2cfe74f tempest-ProjectReaderTests-1887000063 None] Created volume successfully. Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "cinder-87f86c27-866a-4cc9-82ae-fbe0a511bcdf-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-87f86c27-866a-4cc9-82ae-fbe0a511bcdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "cinder-quobyte-7bf774d8-5caa-4225-b120-908d46d919b6" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-quobyte-7bf774d8-5caa-4225-b120-908d46d919b6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "cinder-quobyte-87f86c27-866a-4cc9-82ae-fbe0a511bcdf" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-quobyte-87f86c27-866a-4cc9-82ae-fbe0a511bcdf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Deleting offline snapshot 87f86c27-866a-4cc9-82ae-fbe0a511bcdf of volume 7bf774d8-5caa-4225-b120-908d46d919b6 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] snapshot_file for this snap is: volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc0ec5-2a7e-4533-8c59-85dfc1b8aff7]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:06 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf Sep 11 23:17:06 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:06 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf" returned: 0 in 0.384s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf774d8-5caa-4225-b120-908d46d919b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e542508-ccdf-4655-93ca-e510c79da7e9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:06 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 Sep 11 23:17:06 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:06 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6" returned: 0 in 0.458s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "cinder-4f49de67-4a19-4ca8-9e47-57664265fa49-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:06 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf Sep 11 23:17:06 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-4f49de67-4a19-4ca8-9e47-57664265fa49-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "cinder-quobyte-4f49de67-4a19-4ca8-9e47-57664265fa49" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-quobyte-4f49de67-4a19-4ca8-9e47-57664265fa49" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e69bf-5039-431c-ba6a-0308f78558c1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:07 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 Sep 11 23:17:07 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:07 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf" returned: 0 in 0.443s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:07 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf Sep 11 23:17:07 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:07 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49" returned: 0 in 0.461s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:07 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49 Sep 11 23:17:07 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:07 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6.87f86c27-866a-4cc9-82ae-fbe0a511bcdf" returned: 0 in 0.352s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-quobyte-87f86c27-866a-4cc9-82ae-fbe0a511bcdf" released by "_delete_snapshot" :: held 1.773s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-quobyte-7bf774d8-5caa-4225-b120-908d46d919b6" released by "delete_snapshot" :: held 1.801s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:07 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-4f49de67-4a19-4ca8-9e47-57664265fa49" returned: 0 in 0.352s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Created reservations ['a5ccf0a6-8cf4-4e19-939e-051f219a39ca', '6c7ba9a7-1a6a-4398-a1e8-5ec850ad353d', '4ed9fd02-1de4-4811-ae3f-0bb2a2b0060d', 'b4a2a26b-852f-4b27-8068-6abae88bec05'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-quobyte-4f49de67-4a19-4ca8-9e47-57664265fa49" released by "delete_volume" :: held 0.875s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:07 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Delete snapshot completed successfully. Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-31d823df-7ded-433a-af07-53b190aa4b38 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-87f86c27-866a-4cc9-82ae-fbe0a511bcdf-delete_snapshot" released by "delete_snapshot" :: held 2.066s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:07 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Created reservations ['7c313c93-33f7-44ca-8265-849bcfddc653', '9dc3e0cb-e00e-496d-b78c-0d0b56c16de4', '844d4082-c229-473e-87be-670ac8ebcae4', '69191d06-3be1-46fe-b1e7-57bf0de81500'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:08 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:08 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "cinder-7bf774d8-5caa-4225-b120-908d46d919b6-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-7bf774d8-5caa-4225-b120-908d46d919b6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "cinder-quobyte-7bf774d8-5caa-4225-b120-908d46d919b6" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-quobyte-7bf774d8-5caa-4225-b120-908d46d919b6" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[975f1341-a880-46d5-a38b-03b49588b501]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:08 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 Sep 11 23:17:08 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:08 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.544s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:08 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Deleted volume successfully. Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-fa76d859-2825-4019-a1f6-a60e9a4851d5 tempest-ProjectReaderTests-1887000063 None] Lock "cinder-4f49de67-4a19-4ca8-9e47-57664265fa49-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Flow 'volume_create_manager' (f8453682-57e9-4af8-afd4-5073f12d8cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:08 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9234af48-2217-4b94-b357-94f78f4a895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6" returned: 0 in 0.596s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:08 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6 Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9234af48-2217-4b94-b357-94f78f4a895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1157466233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe786057-5b9e-437f-9aba-6b6c64872312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68f33652804bd6a7fd85e2ab0911d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:09Z,use_quota=True,user_id='840a71e7eeba4ea8bb57abc34b7cd224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:08 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189ea18f-b16f-4da0-b353-4245f8ac4f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189ea18f-b16f-4da0-b353-4245f8ac4f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95f6183-aeb0-40c4-ae8f-3456ad77671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95f6183-aeb0-40c4-ae8f-3456ad77671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe786057-5b9e-437f-9aba-6b6c64872312', 'volume_name': 'volume-fe786057-5b9e-437f-9aba-6b6c64872312', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da464b0f-5c3d-4223-91fb-332d99f504fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da464b0f-5c3d-4223-91fb-332d99f504fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde8d123-39e1-41b7-a0c0-3f4abe36ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:08 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Volume fe786057-5b9e-437f-9aba-6b6c64872312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe786057-5b9e-437f-9aba-6b6c64872312', 'volume_size': 1} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1157466233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe786057-5b9e-437f-9aba-6b6c64872312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b68f33652804bd6a7fd85e2ab0911d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:09Z,use_quota=True,user_id='840a71e7eeba4ea8bb57abc34b7cd224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Creating volume fe786057-5b9e-437f-9aba-6b6c64872312 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:09 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:09 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 1073741824 Sep 11 23:17:09 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:09 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7bf774d8-5caa-4225-b120-908d46d919b6" returned: 0 in 0.314s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-quobyte-7bf774d8-5caa-4225-b120-908d46d919b6" released by "delete_volume" :: held 1.000s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Created reservations ['9ec0505c-f1de-4a01-935a-b4d0f85b13a3', '07ec7f3f-d03e-4241-9ee0-412eb315799d', '6753f986-e31b-4080-a975-75c0ec171542', 'b2a62482-d590-4052-87cb-ae8d0411a43a'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:09 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:09 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:09 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 1073741824" returned: 0 in 0.685s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:09 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 Sep 11 23:17:09 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:09 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.379s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Deleted volume successfully. Sep 11 23:17:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a1fc22d2-3579-46df-9ddb-dc59b4c1da8f tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-7bf774d8-5caa-4225-b120-908d46d919b6-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:10 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312" returned: 0 in 0.338s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde8d123-39e1-41b7-a0c0-3f4abe36ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe786057-5b9e-437f-9aba-6b6c64872312', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21a6927-57ff-4fd8-8776-538b6cf4a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:10 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Volume volume-fe786057-5b9e-437f-9aba-6b6c64872312 (fe786057-5b9e-437f-9aba-6b6c64872312): created successfully Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21a6927-57ff-4fd8-8776-538b6cf4a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Flow 'volume_create_manager' (f8453682-57e9-4af8-afd4-5073f12d8cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:10 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-754c641e-89dd-4e16-a782-dce8e987f50f tempest-ProjectReaderTests-1887000063 None] Created volume successfully. Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "cinder-5145f19f-df1b-4e83-bfe9-c6db8481b379-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-5145f19f-df1b-4e83-bfe9-c6db8481b379-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "cinder-quobyte-5145f19f-df1b-4e83-bfe9-c6db8481b379" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-quobyte-5145f19f-df1b-4e83-bfe9-c6db8481b379" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0dbde-337b-40d0-b1ea-151e951fa066]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:10 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 Sep 11 23:17:10 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Acquiring lock "cinder-fe786057-5b9e-437f-9aba-6b6c64872312-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:10 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379" returned: 0 in 0.399s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:11 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379 Sep 11 23:17:11 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Lock "cinder-fe786057-5b9e-437f-9aba-6b6c64872312-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Acquiring lock "cinder-quobyte-fe786057-5b9e-437f-9aba-6b6c64872312" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Lock "cinder-quobyte-fe786057-5b9e-437f-9aba-6b6c64872312" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[83499a0f-d8e3-490a-b217-8264d55534c9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:11 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 Sep 11 23:17:11 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:11 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5145f19f-df1b-4e83-bfe9-c6db8481b379" returned: 0 in 0.360s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-quobyte-5145f19f-df1b-4e83-bfe9-c6db8481b379" released by "delete_volume" :: held 0.809s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:11 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:11 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Created reservations ['9def2812-6466-449a-8f26-e7d3726e6450', '325fb24a-29b9-45d8-a150-38c8624a0747', '2fe7d5b1-7a9a-4194-a6e8-d1c145a0acfa', '404ed077-84cf-498b-ae21-e056c8de5718'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:11 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:11 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:11 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312" returned: 0 in 0.554s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:11 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312 Sep 11 23:17:11 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:11 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.369s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:17:11 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.310s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:11 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Deleted volume successfully. Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-69f099cc-c819-49d2-a197-662b18d1fd28 tempest-CinderUnicodeTest-1643167674 None] Lock "cinder-5145f19f-df1b-4e83-bfe9-c6db8481b379-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:12 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fe786057-5b9e-437f-9aba-6b6c64872312" returned: 0 in 0.398s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Lock "cinder-quobyte-fe786057-5b9e-437f-9aba-6b6c64872312" released by "delete_volume" :: held 1.003s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Created reservations ['e2ab0559-5db9-4c14-a2f7-8b25fd8596df', 'ec328848-4b22-4582-a97e-e2250e3fe806', 'dae8559d-ab7d-4123-b7ad-aa714bc21d10', '16992a3e-96cb-42e6-b50a-03fd27f1a663'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:12 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:12 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:12 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.314s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:12 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Deleted volume successfully. Sep 11 23:17:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-90a5a95b-5d3e-4f91-9f50-c070dcd5f20e tempest-ProjectReaderTests-1887000063 None] Lock "cinder-fe786057-5b9e-437f-9aba-6b6c64872312-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Flow 'volume_create_manager' (71025e60-8129-4560-a5c5-e592a04e5e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5c3a75-a47a-4093-8493-ca3d5e4e60ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5c3a75-a47a-4093-8493-ca3d5e4e60ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-358025854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513d6c13-d0be-43f9-8072-8d16b39532d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe53425bb053424499015eda480b28b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:13Z,use_quota=True,user_id='9b212d503f994f73a75681d51210bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bcd4c2-0848-4350-86f6-fcfb48da8b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bcd4c2-0848-4350-86f6-fcfb48da8b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377ffd72-1e65-4a5f-9481-03eb65a18709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377ffd72-1e65-4a5f-9481-03eb65a18709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513d6c13-d0be-43f9-8072-8d16b39532d1', 'volume_name': 'volume-513d6c13-d0be-43f9-8072-8d16b39532d1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe47dcd7-d3ca-4749-8a21-88a42ba8d297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe47dcd7-d3ca-4749-8a21-88a42ba8d297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd286ee-9beb-4108-ab74-a2b970144358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Volume 513d6c13-d0be-43f9-8072-8d16b39532d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513d6c13-d0be-43f9-8072-8d16b39532d1', 'volume_size': 1} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-358025854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513d6c13-d0be-43f9-8072-8d16b39532d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe53425bb053424499015eda480b28b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:13Z,use_quota=True,user_id='9b212d503f994f73a75681d51210bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Creating volume 513d6c13-d0be-43f9-8072-8d16b39532d1 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:13 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:13 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 1073741824 Sep 11 23:17:13 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Flow 'volume_create_manager' (bf7e1859-2a2e-4b59-8e23-dddf75a0adfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5edfa3-8567-4529-a74b-afb75c49d969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5edfa3-8567-4529-a74b-afb75c49d969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1672782038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53958064-73c1-4d14-b509-18e5fd5fd6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe53425bb053424499015eda480b28b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:13Z,use_quota=True,user_id='9b212d503f994f73a75681d51210bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dd2002-6241-41ce-a1e5-d2d55c09ab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dd2002-6241-41ce-a1e5-d2d55c09ab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f93d57d-54f6-42b8-b19a-a89e6a67efdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f93d57d-54f6-42b8-b19a-a89e6a67efdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53958064-73c1-4d14-b509-18e5fd5fd6c3', 'volume_name': 'volume-53958064-73c1-4d14-b509-18e5fd5fd6c3', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299906db-d3be-4829-976f-8cfcf74bdb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299906db-d3be-4829-976f-8cfcf74bdb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42dc360-5c26-4d37-860c-824e269178fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Volume 53958064-73c1-4d14-b509-18e5fd5fd6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53958064-73c1-4d14-b509-18e5fd5fd6c3', 'volume_size': 1} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:13 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 1073741824" returned: 0 in 0.669s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:13 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 Sep 11 23:17:13 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:14 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1" returned: 0 in 0.330s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1672782038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53958064-73c1-4d14-b509-18e5fd5fd6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe53425bb053424499015eda480b28b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:13Z,use_quota=True,user_id='9b212d503f994f73a75681d51210bf9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Creating volume 53958064-73c1-4d14-b509-18e5fd5fd6c3 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:14 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd286ee-9beb-4108-ab74-a2b970144358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513d6c13-d0be-43f9-8072-8d16b39532d1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:14 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 1073741824 Sep 11 23:17:14 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe2e92e-71c1-488c-8d6f-35e73950371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:14 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Volume volume-513d6c13-d0be-43f9-8072-8d16b39532d1 (513d6c13-d0be-43f9-8072-8d16b39532d1): created successfully Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe2e92e-71c1-488c-8d6f-35e73950371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Flow 'volume_create_manager' (71025e60-8129-4560-a5c5-e592a04e5e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d31d282e-72be-45d3-b736-672c6300681f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Created volume successfully. Sep 11 23:17:14 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 1073741824" returned: 0 in 0.653s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:14 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 Sep 11 23:17:14 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:15 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3" returned: 0 in 0.313s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42dc360-5c26-4d37-860c-824e269178fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53958064-73c1-4d14-b509-18e5fd5fd6c3', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407cffa9-4ea6-4c26-9325-d969c6d6f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:15 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Volume volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 (53958064-73c1-4d14-b509-18e5fd5fd6c3): created successfully Sep 11 23:17:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407cffa9-4ea6-4c26-9325-d969c6d6f214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Flow 'volume_create_manager' (bf7e1859-2a2e-4b59-8e23-dddf75a0adfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:15 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-63f6baa5-05ee-46d9-9869-47e4b344715f tempest-TestServerVolumeAttachmentScenario-1531958918 None] Created volume successfully. Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Flow 'volume_create_manager' (36f9330f-92a7-43df-a4c7-53efa2a47132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c246c70c-8c5e-4041-8e26-ae9f977a0d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c246c70c-8c5e-4041-8e26-ae9f977a0d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771879806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab82994f-be81-4a97-8e31-3c190c620555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8b2a0bef134fab858ff99c22488b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:17Z,use_quota=True,user_id='29156dc3952f4959805e3ca356c8c6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955b017c-e599-4868-9353-d428cc3c7b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955b017c-e599-4868-9353-d428cc3c7b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffdb3bd-e42e-488e-9eec-a6fc1aa130e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffdb3bd-e42e-488e-9eec-a6fc1aa130e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab82994f-be81-4a97-8e31-3c190c620555', 'volume_name': 'volume-ab82994f-be81-4a97-8e31-3c190c620555', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfcee1c-8020-43d8-9b70-583994fc1a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfcee1c-8020-43d8-9b70-583994fc1a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d50714-11e5-4889-92b1-a4fd2b859795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:17 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Volume ab82994f-be81-4a97-8e31-3c190c620555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab82994f-be81-4a97-8e31-3c190c620555', 'volume_size': 1} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771879806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab82994f-be81-4a97-8e31-3c190c620555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8b2a0bef134fab858ff99c22488b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:17Z,use_quota=True,user_id='29156dc3952f4959805e3ca356c8c6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Creating volume ab82994f-be81-4a97-8e31-3c190c620555 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:17 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:17 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 1073741824 Sep 11 23:17:17 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:17 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 1073741824" returned: 0 in 0.519s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:17 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 Sep 11 23:17:17 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:17 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d50714-11e5-4889-92b1-a4fd2b859795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab82994f-be81-4a97-8e31-3c190c620555', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f78b9a-ffbb-4c8b-b91a-095392cedcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:17 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Volume volume-ab82994f-be81-4a97-8e31-3c190c620555 (ab82994f-be81-4a97-8e31-3c190c620555): created successfully Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f78b9a-ffbb-4c8b-b91a-095392cedcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:17 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Flow 'volume_create_manager' (36f9330f-92a7-43df-a4c7-53efa2a47132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-479f6a84-0f83-492a-ae21-7e989e7724cc tempest-ProjectReaderTests-63829446 None] Created volume successfully. Sep 11 23:17:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Acquiring lock "cinder-ab82994f-be81-4a97-8e31-3c190c620555-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Lock "cinder-ab82994f-be81-4a97-8e31-3c190c620555-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Acquiring lock "cinder-quobyte-ab82994f-be81-4a97-8e31-3c190c620555" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Lock "cinder-quobyte-ab82994f-be81-4a97-8e31-3c190c620555" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0851011-a14f-477d-90e6-8a44ebdb6870]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:19 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 Sep 11 23:17:19 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:19 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555" returned: 0 in 0.378s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:19 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555 Sep 11 23:17:19 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:20 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab82994f-be81-4a97-8e31-3c190c620555" returned: 0 in 0.307s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Lock "cinder-quobyte-ab82994f-be81-4a97-8e31-3c190c620555" released by "delete_volume" :: held 0.735s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Created reservations ['ad86d1f9-0bef-4e4f-b7b9-a8c30db65101', '3a8a5a5b-b46c-49c5-a9ef-c73b5f91a02d', '045ff500-bfe7-42b0-8880-eeff8215087d', '56109b8b-3d6d-4be9-ab25-ade6d0d5c7b9'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:20 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:20 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:20 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.290s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Deleted volume successfully. Sep 11 23:17:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f8a3279e-5686-4f26-91a1-df3198668fb2 tempest-ProjectReaderTests-63829446 None] Lock "cinder-ab82994f-be81-4a97-8e31-3c190c620555-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Flow 'volume_create_manager' (07ba815f-0ed2-40a1-bfd0-3a18eea13670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed21f8e-8e9a-4ccf-b5bf-b68fff4d5a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed21f8e-8e9a-4ccf-b5bf-b68fff4d5a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-212080392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f97039-6bb7-4753-955c-68f057245978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8b2a0bef134fab858ff99c22488b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:21Z,use_quota=True,user_id='29156dc3952f4959805e3ca356c8c6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51dce05-0387-41d2-bf02-1ccbbc3be1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51dce05-0387-41d2-bf02-1ccbbc3be1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0583d90e-5d01-4094-a58f-968c57be590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0583d90e-5d01-4094-a58f-968c57be590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f97039-6bb7-4753-955c-68f057245978', 'volume_name': 'volume-05f97039-6bb7-4753-955c-68f057245978', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd30af0-7785-42f6-9df9-5b568b05c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd30af0-7785-42f6-9df9-5b568b05c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe127a6-eb77-4467-a5a5-3d7361ef91e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:21 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Volume 05f97039-6bb7-4753-955c-68f057245978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f97039-6bb7-4753-955c-68f057245978', 'volume_size': 1} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-212080392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f97039-6bb7-4753-955c-68f057245978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8b2a0bef134fab858ff99c22488b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:21Z,use_quota=True,user_id='29156dc3952f4959805e3ca356c8c6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Creating volume 05f97039-6bb7-4753-955c-68f057245978 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:17:21 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:17:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:21 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 1073741824 Sep 11 23:17:21 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:22 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 1073741824" returned: 0 in 0.830s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:22 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 Sep 11 23:17:22 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:22 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978" returned: 0 in 0.260s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe127a6-eb77-4467-a5a5-3d7361ef91e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f97039-6bb7-4753-955c-68f057245978', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144a8624-d34c-4e43-bb40-683f8b3b2db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:17:22 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Volume volume-05f97039-6bb7-4753-955c-68f057245978 (05f97039-6bb7-4753-955c-68f057245978): created successfully Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144a8624-d34c-4e43-bb40-683f8b3b2db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:17:22 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Flow 'volume_create_manager' (07ba815f-0ed2-40a1-bfd0-3a18eea13670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:17:22 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-bba17705-c967-4063-99a0-35ed9a2f5809 tempest-ProjectReaderTests-63829446 None] Created volume successfully. Sep 11 23:17:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Acquiring lock "cinder-05f97039-6bb7-4753-955c-68f057245978-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Lock "cinder-05f97039-6bb7-4753-955c-68f057245978-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Acquiring lock "cinder-quobyte-05f97039-6bb7-4753-955c-68f057245978" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:23 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Lock "cinder-quobyte-05f97039-6bb7-4753-955c-68f057245978" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:23 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3bc22a-b898-4b51-b973-3a534d7de9b0]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:23 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 Sep 11 23:17:23 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:23 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978" returned: 0 in 0.444s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:23 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978 Sep 11 23:17:23 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:24 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-05f97039-6bb7-4753-955c-68f057245978" returned: 0 in 0.270s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Lock "cinder-quobyte-05f97039-6bb7-4753-955c-68f057245978" released by "delete_volume" :: held 0.778s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Created reservations ['1fb9a65a-b4e6-4ecc-a636-07008c913959', '159143a5-6a84-47ac-b5e3-939799ea4a87', '14651ee4-dd55-4ec3-947c-ff69f5eb9ef5', '66c3dbf6-7ccf-4c34-b740-592c203ec7f7'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:24 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:24 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:24 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.362s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Deleted volume successfully. Sep 11 23:17:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-19312cb5-22d9-4182-b9ae-d16feab0f904 tempest-ProjectReaderTests-63829446 None] Lock "cinder-05f97039-6bb7-4753-955c-68f057245978-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:34 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=158,cinder:INSERT=55,cinder:UPDATE=195,cinder:DELETE=13 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:17:34 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=137,cinder:UPDATE=222,cinder:INSERT=60,cinder:DELETE=23 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:17:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-f46da568-3f06-4f44-8940-d7b507469164 req-3ffd803e-d324-4298-b688-a4703c62603b tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-f46da568-3f06-4f44-8940-d7b507469164 req-3ffd803e-d324-4298-b688-a4703c62603b tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-f46da568-3f06-4f44-8940-d7b507469164 req-3ffd803e-d324-4298-b688-a4703c62603b tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-f46da568-3f06-4f44-8940-d7b507469164 req-3ffd803e-d324-4298-b688-a4703c62603b tempest-TestServerVolumeAttachmentScenario-1531958918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-513d6c13-d0be-43f9-8072-8d16b39532d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bce71aa6-64df-473e-b798-7dc1e8358cea', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:17:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-f46da568-3f06-4f44-8940-d7b507469164 req-3ffd803e-d324-4298-b688-a4703c62603b tempest-TestServerVolumeAttachmentScenario-1531958918 None] attachment_update completed successfully. Sep 11 23:17:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-e414da1a-bdaa-4506-a382-4f41d1b238ff req-71817cce-1f6e-491b-840e-2a5898c6b5b1 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-e414da1a-bdaa-4506-a382-4f41d1b238ff req-71817cce-1f6e-491b-840e-2a5898c6b5b1 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [req-e414da1a-bdaa-4506-a382-4f41d1b238ff req-71817cce-1f6e-491b-840e-2a5898c6b5b1 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-e414da1a-bdaa-4506-a382-4f41d1b238ff req-71817cce-1f6e-491b-840e-2a5898c6b5b1 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2', 'name': 'volume-53958064-73c1-4d14-b509-18e5fd5fd6c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c82e867-10ba-4a50-90b8-cd2b3e7a4ec9', 'enforce_multipath': True} {{(pid=88026) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 11 23:17:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-e414da1a-bdaa-4506-a382-4f41d1b238ff req-71817cce-1f6e-491b-840e-2a5898c6b5b1 tempest-TestServerVolumeAttachmentScenario-1531958918 None] attachment_update completed successfully. Sep 11 23:17:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-13d189a5-790b-4e9e-99d0-8dbaae86da5e req-a248ff07-e85b-4eb1-b9c3-b690c5b54596 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Terminate volume connection completed successfully. Sep 11 23:17:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-13d189a5-790b-4e9e-99d0-8dbaae86da5e req-a248ff07-e85b-4eb1-b9c3-b690c5b54596 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Deleting attachment 5c82e867-10ba-4a50-90b8-cd2b3e7a4ec9. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:17:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [req-31d601fe-7e75-48da-9357-109fd16bb1e8 req-b1a468fd-6be3-4890-a55e-384530df16ec tempest-TestServerVolumeAttachmentScenario-1531958918 None] Terminate volume connection completed successfully. Sep 11 23:17:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [req-31d601fe-7e75-48da-9357-109fd16bb1e8 req-b1a468fd-6be3-4890-a55e-384530df16ec tempest-TestServerVolumeAttachmentScenario-1531958918 None] Deleting attachment bce71aa6-64df-473e-b798-7dc1e8358cea. {{(pid=88026) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 11 23:17:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "cinder-53958064-73c1-4d14-b509-18e5fd5fd6c3-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "cinder-53958064-73c1-4d14-b509-18e5fd5fd6c3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "cinder-quobyte-53958064-73c1-4d14-b509-18e5fd5fd6c3" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "cinder-quobyte-53958064-73c1-4d14-b509-18e5fd5fd6c3" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dabf22-c92d-4c2a-9cb0-9609cebd2537]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:57 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 Sep 11 23:17:57 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:57 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3" returned: 0 in 0.383s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:57 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3 Sep 11 23:17:57 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:57 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-53958064-73c1-4d14-b509-18e5fd5fd6c3" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "cinder-quobyte-53958064-73c1-4d14-b509-18e5fd5fd6c3" released by "delete_volume" :: held 0.700s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Created reservations ['747260c7-0f80-49a7-ac75-a49f54b1f582', '1b3fca88-c3dd-42fd-98f8-2fef4cf8aff2', '2e1b2593-821f-4ff5-86af-28452c08e055', 'bd989f6b-abbe-426d-b03b-64c8c876a5dc'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:57 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:57 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:58 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.241s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Deleted volume successfully. Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "cinder-513d6c13-d0be-43f9-8072-8d16b39532d1-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-01496804-5606-4522-8c06-7084a10d3eb2 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "cinder-53958064-73c1-4d14-b509-18e5fd5fd6c3-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "cinder-513d6c13-d0be-43f9-8072-8d16b39532d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "cinder-quobyte-513d6c13-d0be-43f9-8072-8d16b39532d1" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "cinder-quobyte-513d6c13-d0be-43f9-8072-8d16b39532d1" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b745cb26-70a0-4eb9-8202-1f2030416033]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:58 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 Sep 11 23:17:58 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:58 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1" returned: 0 in 0.351s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:58 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1 Sep 11 23:17:58 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:58 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-513d6c13-d0be-43f9-8072-8d16b39532d1" returned: 0 in 0.248s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "cinder-quobyte-513d6c13-d0be-43f9-8072-8d16b39532d1" released by "delete_volume" :: held 0.637s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Created reservations ['b1043585-c61c-4d7d-b435-f9d2b25b7c95', 'e0aa213e-0d95-41e7-9d54-c4d306ddebaa', '58332ad5-1bf4-45aa-b9ab-8c86b0f64c42', '7611d923-d251-4d08-b0bb-4ac36e0ef6bd'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:17:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:17:58 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:17:58 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:17:59 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 11 23:17:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:17:59 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:17:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Deleted volume successfully. Sep 11 23:17:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-171b043d-1bfb-4fd0-8ddf-3c5cf0c5e5f4 tempest-TestServerVolumeAttachmentScenario-1531958918 None] Lock "cinder-513d6c13-d0be-43f9-8072-8d16b39532d1-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:08 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=24,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:18:09 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:11 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:18:11 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:11 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.286s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:18:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Flow 'volume_create_manager' (e77cbfa4-b3fb-4a02-8de8-acc0cc63ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030cae4e-980d-4c61-900c-a0f42449bf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030cae4e-980d-4c61-900c-a0f42449bf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1292638976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3f439d-f887-4777-bea8-a93968730930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eae2c2e481e403484dc771ccb075fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:34Z,use_quota=True,user_id='6192a7878219474a944b4316abb1d923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ca3a3e-9e8f-4276-94be-2cd98564dbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ca3a3e-9e8f-4276-94be-2cd98564dbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4668e4dc-57ad-4dab-8963-e98b3c9a3ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4668e4dc-57ad-4dab-8963-e98b3c9a3ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3f439d-f887-4777-bea8-a93968730930', 'volume_name': 'volume-fa3f439d-f887-4777-bea8-a93968730930', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa063551-e77b-4c09-884a-8fa3b24fdb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa063551-e77b-4c09-884a-8fa3b24fdb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f5fece-5964-49c5-a933-5299eb60f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Volume fa3f439d-f887-4777-bea8-a93968730930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3f439d-f887-4777-bea8-a93968730930', 'volume_size': 1} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1292638976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3f439d-f887-4777-bea8-a93968730930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eae2c2e481e403484dc771ccb075fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:34Z,use_quota=True,user_id='6192a7878219474a944b4316abb1d923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Creating volume fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:34 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:34 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 1073741824 Sep 11 23:18:34 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:34 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 1073741824" returned: 0 in 0.452s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:34 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 Sep 11 23:18:34 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:34 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930" returned: 0 in 0.256s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f5fece-5964-49c5-a933-5299eb60f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3f439d-f887-4777-bea8-a93968730930', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c5b870-6f6b-4043-a5a6-c45c4f130769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Volume volume-fa3f439d-f887-4777-bea8-a93968730930 (fa3f439d-f887-4777-bea8-a93968730930): created successfully Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c5b870-6f6b-4043-a5a6-c45c4f130769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Flow 'volume_create_manager' (e77cbfa4-b3fb-4a02-8de8-acc0cc63ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-885e5cff-0c56-413a-99ad-1a84ca26d3a2 tempest-SnapshotDependencyTests-276973506 None] Created volume successfully. Sep 11 23:18:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Creating offline snapshot 84a75255-aad3-4c10-a260-98868b821158 of volume fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:18:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dc7dc8-e789-443a-b44a-b1b4104c0334]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:35 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 Sep 11 23:18:35 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:35 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930" returned: 0 in 0.400s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:35 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 1G Sep 11 23:18:35 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:36 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 1G" returned: 0 in 0.406s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3f439d-f887-4777-bea8-a93968730930 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:36 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3f439d-f887-4777-bea8-a93968730930 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 Sep 11 23:18:36 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:36 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3f439d-f887-4777-bea8-a93968730930 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158" returned: 0 in 0.324s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:36 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 is being set with open permissions: ugo+rw Sep 11 23:18:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:36 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 Sep 11 23:18:36 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:36 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158" returned: 0 in 0.267s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:36 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.info Sep 11 23:18:36 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:37 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.info" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:37 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.info is being set with open permissions: ugo+rw Sep 11 23:18:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:37 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.info Sep 11 23:18:37 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:37 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.info" returned: 0 in 0.259s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cfbf0181-dd7b-42a6-9bf9-41a7f805349a tempest-SnapshotDependencyTests-276973506 None] Create snapshot completed successfully Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Flow 'volume_create_manager' (09f02041-91be-46b1-be02-0e88e4ca5c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec15f95-158c-4c89-8fa9-77c732b0ccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec15f95-158c-4c89-8fa9-77c732b0ccc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249b48e1-c696-4985-9877-434ef28234ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eae2c2e481e403484dc771ccb075fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=84a75255-aad3-4c10-a260-98868b821158,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:39Z,use_quota=True,user_id='6192a7878219474a944b4316abb1d923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de965530-180d-4b20-95d6-06eb11a1e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de965530-180d-4b20-95d6-06eb11a1e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c301df1e-25c8-42ea-9dfc-aa307da20548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c301df1e-25c8-42ea-9dfc-aa307da20548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '249b48e1-c696-4985-9877-434ef28234ec', 'volume_name': 'volume-249b48e1-c696-4985-9877-434ef28234ec', 'volume_size': 1, 'snapshot_id': '84a75255-aad3-4c10-a260-98868b821158'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185930d9-6112-4c01-aa8a-6d92bdfe8b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185930d9-6112-4c01-aa8a-6d92bdfe8b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540e50fd-49f7-4d60-95e4-d695d88367c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:39 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Volume 249b48e1-c696-4985-9877-434ef28234ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-249b48e1-c696-4985-9877-434ef28234ec', 'volume_size': 1, 'snapshot_id': '84a75255-aad3-4c10-a260-98868b821158'} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-quobyte-84a75255-aad3-4c10-a260-98868b821158-249b48e1-c696-4985-9877-434ef28234ec" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-84a75255-aad3-4c10-a260-98868b821158-249b48e1-c696-4985-9877-434ef28234ec" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Creating volume 249b48e1-c696-4985-9877-434ef28234ec from snapshot 84a75255-aad3-4c10-a260-98868b821158 {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-quobyte-249b48e1-c696-4985-9877-434ef28234ec" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-249b48e1-c696-4985-9877-434ef28234ec" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] snapshot: 84a75255-aad3-4c10-a260-98868b821158, volume: 249b48e1-c696-4985-9877-434ef28234ec, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3180af0c-5038-451e-ac93-714e8191cd18]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:39 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 Sep 11 23:18:39 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:39 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158" returned: 0 in 0.406s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa3f439d-f887-4777-bea8-a93968730930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d552197b-a5d2-4de3-bd5f-d5ce69b7404d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:39 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 Sep 11 23:18:39 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:40 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930" returned: 0 in 0.419s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:18:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:18:40 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:18:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:40 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec Sep 11 23:18:40 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:44 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec" returned: 0 in 4.450s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930, size 1024.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:18:44 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Converted 1024.00 MB image at 230.05 MB/s Sep 11 23:18:44 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec is being set with open permissions: ugo+rw Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:44 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec Sep 11 23:18:44 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:44 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec" returned: 0 in 0.277s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-249b48e1-c696-4985-9877-434ef28234ec" released by "_copy_volume_from_snapshot" :: held 5.637s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-84a75255-aad3-4c10-a260-98868b821158-249b48e1-c696-4985-9877-434ef28234ec" released by "_create_volume_from_snapshot" :: held 5.702s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.718s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540e50fd-49f7-4d60-95e4-d695d88367c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249b48e1-c696-4985-9877-434ef28234ec', 'volume_size': 1, 'snapshot_id': '84a75255-aad3-4c10-a260-98868b821158'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064228bc-5d45-4432-b540-248c1d27fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:18:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Volume volume-249b48e1-c696-4985-9877-434ef28234ec (249b48e1-c696-4985-9877-434ef28234ec): created successfully Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064228bc-5d45-4432-b540-248c1d27fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Flow 'volume_create_manager' (09f02041-91be-46b1-be02-0e88e4ca5c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:18:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-bd8c5f30-c54f-4dcd-8ad3-85307f6dcdc3 tempest-SnapshotDependencyTests-276973506 None] Created volume successfully. Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-84a75255-aad3-4c10-a260-98868b821158-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-84a75255-aad3-4c10-a260-98868b821158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-quobyte-fa3f439d-f887-4777-bea8-a93968730930" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-fa3f439d-f887-4777-bea8-a93968730930" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-quobyte-84a75255-aad3-4c10-a260-98868b821158" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-84a75255-aad3-4c10-a260-98868b821158" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Deleting offline snapshot 84a75255-aad3-4c10-a260-98868b821158 of volume fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] snapshot_file for this snap is: volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b42efa-97fd-4677-b326-989e0850ef86]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:46 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 Sep 11 23:18:46 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:46 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158" returned: 0 in 0.386s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa3f439d-f887-4777-bea8-a93968730930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:18:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ef23c-210c-4d4f-b8f8-2e60d5b9c4e2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:46 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 Sep 11 23:18:46 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:46 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930" returned: 0 in 0.583s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:47 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 Sep 11 23:18:47 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:47 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158" returned: 0 in 0.346s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:47 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158 Sep 11 23:18:47 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:47 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930.84a75255-aad3-4c10-a260-98868b821158" returned: 0 in 0.263s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-84a75255-aad3-4c10-a260-98868b821158" released by "_delete_snapshot" :: held 1.676s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-fa3f439d-f887-4777-bea8-a93968730930" released by "delete_snapshot" :: held 1.702s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:47 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Created reservations ['6a7eb287-38a1-41e6-a476-21f8192ab6c6', '9850b9cd-3b0e-46c6-acfa-7ad007bbfd5c', '76e7cd53-57b4-42aa-abbf-b95590660385', '6227c361-66d9-4ef1-88e0-4045dd8d385f'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Delete snapshot completed successfully. Sep 11 23:18:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7d562efc-c1f4-46e2-9392-9ddcd1ddd4ba tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-84a75255-aad3-4c10-a260-98868b821158-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-fa3f439d-f887-4777-bea8-a93968730930-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-fa3f439d-f887-4777-bea8-a93968730930-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-quobyte-fa3f439d-f887-4777-bea8-a93968730930" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-fa3f439d-f887-4777-bea8-a93968730930" acquired by "delete_volume" :: waited 0.014s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[622acd32-a8a1-41f7-a504-e6aa1ff27207]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:48 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 Sep 11 23:18:48 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:48 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930" returned: 0 in 0.349s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:48 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930 Sep 11 23:18:48 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:48 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fa3f439d-f887-4777-bea8-a93968730930" returned: 0 in 0.241s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-fa3f439d-f887-4777-bea8-a93968730930" released by "delete_volume" :: held 0.644s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Created reservations ['2f3bc6bd-2432-406c-8669-d80b3a227c22', '0a99fbdc-b527-4cfa-849a-e675c83c8c6d', 'ae025f86-9edd-4ffd-a74a-2238679f7859', 'c013ad2d-6ce9-4eec-85c9-321d0558d081'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:48 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:18:48 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:49 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.246s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Deleted volume successfully. Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e2dcb89-4905-4270-bcdf-65df63a02c2e tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-fa3f439d-f887-4777-bea8-a93968730930-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-249b48e1-c696-4985-9877-434ef28234ec-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-249b48e1-c696-4985-9877-434ef28234ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "cinder-quobyte-249b48e1-c696-4985-9877-434ef28234ec" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-249b48e1-c696-4985-9877-434ef28234ec" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[436c6078-da87-4e5c-8d33-66b24b6f6e15]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:49 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec Sep 11 23:18:49 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:49 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec" returned: 0 in 0.367s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:49 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec Sep 11 23:18:49 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:49 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-249b48e1-c696-4985-9877-434ef28234ec" returned: 0 in 0.245s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-quobyte-249b48e1-c696-4985-9877-434ef28234ec" released by "delete_volume" :: held 0.649s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:18:49 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Created reservations ['686edc7c-9ee6-4bbe-8bff-88c0974fbbf6', 'd06c5527-e03d-4c34-9bbd-ae8860b3c2ec', '08fa2c5f-f74b-4395-94b6-30ba9a604f26', '7923f7e1-f27b-47e4-ada2-6f23118893b5'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:18:50 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:18:50 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:18:50 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.239s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:18:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Deleted volume successfully. Sep 11 23:18:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-46ca4053-7e66-4ad8-b0ba-b44e223bf7fe tempest-SnapshotDependencyTests-276973506 None] Lock "cinder-249b48e1-c696-4985-9877-434ef28234ec-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:00 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:19:00 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=32,cinder:SELECT=24,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:11 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:11 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Flow 'volume_create_manager' (d6c410a5-8d20-4d12-a297-e3fa7379b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564da383-6a28-439b-97ef-d6b75b860e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564da383-6a28-439b-97ef-d6b75b860e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1208049128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec87453-b1d5-49ec-bb8e-bd855a2f996b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c9b4e7ec70419cac99291fddd4f08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:12Z,use_quota=True,user_id='9bf7cde5f10b4d92a2cb864455d58fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f341431c-d115-4e95-90b9-cce073030efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f341431c-d115-4e95-90b9-cce073030efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5be51ad-862e-491f-87ce-976349be8fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5be51ad-862e-491f-87ce-976349be8fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec87453-b1d5-49ec-bb8e-bd855a2f996b', 'volume_name': 'volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8245a31a-812d-4d95-b135-930a13c039ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8245a31a-812d-4d95-b135-930a13c039ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9baccef-b9dd-46db-82d2-d26fbb589b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Volume 9ec87453-b1d5-49ec-bb8e-bd855a2f996b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b', 'volume_size': 1} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1208049128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec87453-b1d5-49ec-bb8e-bd855a2f996b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c9b4e7ec70419cac99291fddd4f08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:12Z,use_quota=True,user_id='9bf7cde5f10b4d92a2cb864455d58fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Creating volume 9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:11 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (75515c46-de03-4767-9ec1-78597297b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890b7318-9ec4-4171-9b2c-5df65d95a7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b 1073741824 Sep 11 23:19:11 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890b7318-9ec4-4171-9b2c-5df65d95a7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-168616996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076d49b7-be2f-475b-b317-89a5aaf050ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:12Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f09613-fb2d-4847-b9c7-2edb01320f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f09613-fb2d-4847-b9c7-2edb01320f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b149f5d-fe21-4fce-a53c-e5fa1d4b1e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b149f5d-fe21-4fce-a53c-e5fa1d4b1e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076d49b7-be2f-475b-b317-89a5aaf050ba', 'volume_name': 'volume-076d49b7-be2f-475b-b317-89a5aaf050ba', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f40cf8-d2c8-40dc-8af1-92d7af9870ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f40cf8-d2c8-40dc-8af1-92d7af9870ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed09f2c6-548e-4c3f-9237-e4e609f3c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:11 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Volume 076d49b7-be2f-475b-b317-89a5aaf050ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076d49b7-be2f-475b-b317-89a5aaf050ba', 'volume_size': 1} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.519s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:11 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:19:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (be536cd9-7dfa-4c0b-bd91-ce04af193a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd8da21-1d16-4ec9-92d1-d6e41daefe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd8da21-1d16-4ec9-92d1-d6e41daefe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-125866610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:12Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd1b82e-1000-4f9c-9886-87d5878b6fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd1b82e-1000-4f9c-9886-87d5878b6fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e1701e-eb5a-437d-a6b1-8b313acbdf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e1701e-eb5a-437d-a6b1-8b313acbdf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0', 'volume_name': 'volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd43da51-7d23-4196-8a85-3197af637eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd43da51-7d23-4196-8a85-3197af637eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07a88f6-a5bf-4415-a657-858cc8f4f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Volume d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0', 'volume_size': 1} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:12 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b 1073741824" returned: 0 in 0.802s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (9bf03597-7d2f-4b02-be1c-89e77c18ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae3af2c-1f8d-4479-9262-d00218db6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae3af2c-1f8d-4479-9262-d00218db6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-325882533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf8c869-571d-4bfa-988c-4d2061ec0c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:13Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40e2258-a182-4828-a6ef-3bcccdcca955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40e2258-a182-4828-a6ef-3bcccdcca955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de3d287-ddaa-41c7-8e58-480019ed882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de3d287-ddaa-41c7-8e58-480019ed882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf8c869-571d-4bfa-988c-4d2061ec0c50', 'volume_name': 'volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cfcb7a-8fc6-4fa2-b887-8a00b3f0b975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cfcb7a-8fc6-4fa2-b887-8a00b3f0b975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cf1861-20af-4212-9ed2-5367b11807e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:12 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Volume 9bf8c869-571d-4bfa-988c-4d2061ec0c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50', 'volume_size': 1} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:12 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b Sep 11 23:19:12 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:13 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" returned: 0 in 0.358s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.211s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-168616996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076d49b7-be2f-475b-b317-89a5aaf050ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:12Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Creating volume 076d49b7-be2f-475b-b317-89a5aaf050ba {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:13 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9baccef-b9dd-46db-82d2-d26fbb589b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c850e0be-053c-4406-97a5-bacf6594dee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba 1073741824 Sep 11 23:19:13 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (ab992b9a-864c-4770-9bd7-94231c363296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b97474-45ed-46cc-afcb-46609ad1b58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Volume volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b (9ec87453-b1d5-49ec-bb8e-bd855a2f996b): created successfully Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c850e0be-053c-4406-97a5-bacf6594dee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Flow 'volume_create_manager' (d6c410a5-8d20-4d12-a297-e3fa7379b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b97474-45ed-46cc-afcb-46609ad1b58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-770163080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092a94d9-d02d-4fb4-8b24-ac088cbac98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:13Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33332fa8-fda9-4687-ab74-e9f10483e111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33332fa8-fda9-4687-ab74-e9f10483e111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9256e19e-df94-47f5-bc84-103ada6634b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9256e19e-df94-47f5-bc84-103ada6634b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092a94d9-d02d-4fb4-8b24-ac088cbac98b', 'volume_name': 'volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48b02a7-d97f-43cb-9b5b-4e37198dae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48b02a7-d97f-43cb-9b5b-4e37198dae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d433ebc3-18e0-47c3-8eb4-c0980e52349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Volume 092a94d9-d02d-4fb4-8b24-ac088cbac98b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b', 'volume_size': 1} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:13 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-614e49b8-0aab-4727-ae7b-e34f6760d863 tempest-VolumeDependencyTests-2084520405 None] Created volume successfully. Sep 11 23:19:13 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba 1073741824" returned: 0 in 0.646s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:13 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba Sep 11 23:19:13 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (5d3e3256-9003-4be0-9c30-d6a87fd605b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d24f880-db8a-4577-b057-0174bffb720c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d24f880-db8a-4577-b057-0174bffb720c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-673138654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da237b02-7e74-498f-964e-3489c57531ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:14Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72866ae2-7786-4631-85ed-ea72c587957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72866ae2-7786-4631-85ed-ea72c587957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a880f9fe-c385-4197-ad37-9d41b3790647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a880f9fe-c385-4197-ad37-9d41b3790647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da237b02-7e74-498f-964e-3489c57531ed', 'volume_name': 'volume-da237b02-7e74-498f-964e-3489c57531ed', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9a9e37-9c72-4edd-ace2-58c95164e4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9a9e37-9c72-4edd-ace2-58c95164e4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8ae242-118f-44bb-a44f-0bae73f45e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:14 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Volume da237b02-7e74-498f-964e-3489c57531ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da237b02-7e74-498f-964e-3489c57531ed', 'volume_size': 1} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:14 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba" returned: 0 in 0.351s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.858s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-125866610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:12Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Creating volume d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:14 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed09f2c6-548e-4c3f-9237-e4e609f3c60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076d49b7-be2f-475b-b317-89a5aaf050ba', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126b156b-afa0-400c-b654-223f4afaebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:14 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 1073741824 Sep 11 23:19:14 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:14 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Volume volume-076d49b7-be2f-475b-b317-89a5aaf050ba (076d49b7-be2f-475b-b317-89a5aaf050ba): created successfully Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126b156b-afa0-400c-b654-223f4afaebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (75515c46-de03-4767-9ec1-78597297b02f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-79c851b0-36e3-4413-97cb-75b5fb0900cb tempest-CreateVolumesFromImageTest-421743407 None] Created volume successfully. Sep 11 23:19:14 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 1073741824" returned: 0 in 0.549s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:14 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 Sep 11 23:19:14 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:15 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0" returned: 0 in 0.336s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.413s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-325882533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf8c869-571d-4bfa-988c-4d2061ec0c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:13Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Creating volume 9bf8c869-571d-4bfa-988c-4d2061ec0c50 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:15 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:15 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 1073741824 Sep 11 23:19:15 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07a88f6-a5bf-4415-a657-858cc8f4f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49b738d-b2a4-42aa-a280-7db09d7e2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Flow 'volume_create_manager' (8521e057-43fe-4e8c-a962-61e66582c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee197233-ca0a-4a0d-9644-9601ff8cfece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:15 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Volume volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 (d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0): created successfully Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49b738d-b2a4-42aa-a280-7db09d7e2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (be536cd9-7dfa-4c0b-bd91-ce04af193a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee197233-ca0a-4a0d-9644-9601ff8cfece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9ce6f2-18f9-477a-9855-df07675d6712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ad4d73cbbe4a3787e49f07a9e4e57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:15Z,use_quota=True,user_id='3cd0b4653c06420baa66b7f413d6e867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32545350-96fc-40f9-bf4f-2b5ead447fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32545350-96fc-40f9-bf4f-2b5ead447fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304d47ae-0f51-485b-8b57-34816eead68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:19:15 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d40fd620-fc59-472d-a551-5fa053f82877 tempest-CreateVolumesFromImageTest-421743407 None] Created volume successfully. Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304d47ae-0f51-485b-8b57-34816eead68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b9ce6f2-18f9-477a-9855-df07675d6712', 'volume_name': 'volume-9b9ce6f2-18f9-477a-9855-df07675d6712', 'volume_size': 1, 'image_id': '892049b6-0d3e-4090-b820-3927a0c0de72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/892049b6-0d3e-4090-b820-3927a0c0de72', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55920dce5db7629e34a0e6edade6278f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30ad4d73cbbe4a3787e49f07a9e4e57b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2d3ac776ab788c7069a8f23c2b596e865a4eff2af49f689ea90c82dfe88f97c4521bee4a1c769966b59e1c7a81016653c5ae4e794364ceba8ee1264a4502ab8', 'id': '892049b6-0d3e-4090-b820-3927a0c0de72', 'created_at': datetime.datetime(2026, 9, 11, 21, 19, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 19, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/892049b6-0d3e-4090-b820-3927a0c0de72/file', 'properties': {}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfef7a92-152b-49ae-8b5c-456c0f51e34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfef7a92-152b-49ae-8b5c-456c0f51e34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd48982f-73cc-44ac-a1d8-0f35bdc4b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:15 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Volume 9b9ce6f2-18f9-477a-9855-df07675d6712: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b9ce6f2-18f9-477a-9855-df07675d6712', 'volume_size': 1, 'image_id': '892049b6-0d3e-4090-b820-3927a0c0de72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/892049b6-0d3e-4090-b820-3927a0c0de72', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55920dce5db7629e34a0e6edade6278f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30ad4d73cbbe4a3787e49f07a9e4e57b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2d3ac776ab788c7069a8f23c2b596e865a4eff2af49f689ea90c82dfe88f97c4521bee4a1c769966b59e1c7a81016653c5ae4e794364ceba8ee1264a4502ab8', 'id': '892049b6-0d3e-4090-b820-3927a0c0de72', 'created_at': datetime.datetime(2026, 9, 11, 21, 19, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 19, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/892049b6-0d3e-4090-b820-3927a0c0de72/file', 'properties': {}}, 'image_service': } Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Trying to clone 9b9ce6f2-18f9-477a-9855-df07675d6712 from image 892049b6-0d3e-4090-b820-3927a0c0de72 at location (None, [{'url': 'file:///opt/stack/data/glance/images/892049b6-0d3e-4090-b820-3927a0c0de72', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:19:15 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 1073741824" returned: 0 in 0.538s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:15 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 Sep 11 23:19:15 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:19:15 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Image download 0.00 MB at 0.00 MB/s Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43a8926-970b-4936-8911-ea7745c3e8ed]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:15 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD Sep 11 23:19:15 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:15 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50" returned: 0 in 0.273s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.651s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-770163080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092a94d9-d02d-4fb4-8b24-ac088cbac98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:13Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Creating volume 092a94d9-d02d-4fb4-8b24-ac088cbac98b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:16 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cf1861-20af-4212-9ed2-5367b11807e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7c52ea-a407-4beb-95e5-56c2213fccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:16 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b 1073741824 Sep 11 23:19:16 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:16 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Volume volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 (9bf8c869-571d-4bfa-988c-4d2061ec0c50): created successfully Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7c52ea-a407-4beb-95e5-56c2213fccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (9bf03597-7d2f-4b02-be1c-89e77c18ae18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b0dd1665-facd-4348-b083-ddecf3a66215 tempest-CreateVolumesFromImageTest-421743407 None] Created volume successfully. Sep 11 23:19:16 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Flow 'volume_create_manager' (169a676b-302b-4580-8948-670e8e46fafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:16 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD Sep 11 23:19:16 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdc0554-fd8e-444f-bd54-478b1efefe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdc0554-fd8e-444f-bd54-478b1efefe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3acb4e-9741-434b-8ae8-d00d48111cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7839b51371c14d758968f346c41098da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:16Z,use_quota=True,user_id='7a2cd8e7f9b742de9637461dd1769431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a824d2e3-3ecc-4242-8e0d-3c26d0ff83fa),volume_type_id=a824d2e3-3ecc-4242-8e0d-3c26d0ff83fa)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aac0ee6-183c-4080-afd4-14759030a4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aac0ee6-183c-4080-afd4-14759030a4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66816c2b-6f4b-40b0-9880-e3b359cad148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.image.glance [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Creating Keystone auth plugin from conf {{(pid=88026) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 11 23:19:16 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b 1073741824" returned: 0 in 0.523s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:16 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b Sep 11 23:19:16 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:16 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Temporary image 892049b6-0d3e-4090-b820-3927a0c0de72 is fetched for user 3cd0b4653c06420baa66b7f413d6e867. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66816c2b-6f4b-40b0-9880-e3b359cad148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c3acb4e-9741-434b-8ae8-d00d48111cd0', 'volume_name': 'volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0', 'volume_size': 1, 'image_id': '112688d5-e2bb-46b3-beef-a88356cedfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/112688d5-e2bb-46b3-beef-a88356cedfed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e5c914fdd30ad3a02c30400bde46448', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7839b51371c14d758968f346c41098da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec02034dc4be83865ed64574e90ca65c39c007d70b92d5f104f1c7fb152c012a800a7ded4781eec4aadff1da221b63727237ff4d3c01bd9bee707d828f959d09', 'id': '112688d5-e2bb-46b3-beef-a88356cedfed', 'created_at': datetime.datetime(2026, 9, 11, 21, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 19, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/112688d5-e2bb-46b3-beef-a88356cedfed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5f5f72-3bd8-4c74-b338-ea0a710e27ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5f5f72-3bd8-4c74-b338-ea0a710e27ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ee2697-b85d-48b2-8c10-985d05b74f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:16 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Volume 2c3acb4e-9741-434b-8ae8-d00d48111cd0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0', 'volume_size': 1, 'image_id': '112688d5-e2bb-46b3-beef-a88356cedfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/112688d5-e2bb-46b3-beef-a88356cedfed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e5c914fdd30ad3a02c30400bde46448', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7839b51371c14d758968f346c41098da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec02034dc4be83865ed64574e90ca65c39c007d70b92d5f104f1c7fb152c012a800a7ded4781eec4aadff1da221b63727237ff4d3c01bd9bee707d828f959d09', 'id': '112688d5-e2bb-46b3-beef-a88356cedfed', 'created_at': datetime.datetime(2026, 9, 11, 21, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 19, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/112688d5-e2bb-46b3-beef-a88356cedfed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Trying to clone 2c3acb4e-9741-434b-8ae8-d00d48111cd0 from image 112688d5-e2bb-46b3-beef-a88356cedfed at location (None, [{'url': 'file:///opt/stack/data/glance/images/112688d5-e2bb-46b3-beef-a88356cedfed', 'metadata': {}}]). {{(pid=88026) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[96410316-788e-4237-8acb-86a9fdfeffe4]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 11 23:19:16 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Image download 0.00 MB at 0.00 MB/s Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60903d68-32e8-4d0e-8726-381c1b953f54]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:16 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:16 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD Sep 11 23:19:16 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b" returned: 0 in 0.286s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.927s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d433ebc3-18e0-47c3-8eb4-c0980e52349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2802bb2-560b-43d1-9a06-70f85d13d609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Creating offline snapshot 6801ab1b-76e4-4623-b4ac-d1edbb6d1260 of volume 9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:16 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Volume volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b (092a94d9-d02d-4fb4-8b24-ac088cbac98b): created successfully Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2802bb2-560b-43d1-9a06-70f85d13d609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:16 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD Sep 11 23:19:16 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (ab992b9a-864c-4770-9bd7-94231c363296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5cae9a-cc9e-474b-a1c2-58194f4b80fa]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6bdcb3d1-12b0-47ad-9067-375862d0a3c2 tempest-CreateVolumesFromImageTest-421743407 None] Created volume successfully. Sep 11 23:19:17 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:17 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b Sep 11 23:19:17 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:17 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:17 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD Sep 11 23:19:17 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:17 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD Sep 11 23:19:17 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:17 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" returned: 0 in 0.432s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:17 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 1G Sep 11 23:19:17 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:17 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD" returned: 1 in 0.365s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:17 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Temporary image 112688d5-e2bb-46b3-beef-a88356cedfed is fetched for user 7a2cd8e7f9b742de9637461dd1769431. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39b687e-287e-4a98-b9e5-8275a218bcc7]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:17 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD Sep 11 23:19:17 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:17 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 1G" returned: 0 in 0.409s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:17 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 Sep 11 23:19:17 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:18 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:18 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260" returned: 0 in 0.312s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 is being set with open permissions: ugo+rw Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:18 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 Sep 11 23:19:18 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:18 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD Sep 11 23:19:18 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:18 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260" returned: 0 in 0.277s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:18 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.info Sep 11 23:19:18 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:18 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.info" returned: 0 in 0.295s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.info is being set with open permissions: ugo+rw Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:18 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.info Sep 11 23:19:18 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:18 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.info" returned: 0 in 0.238s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.978s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-673138654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da237b02-7e74-498f-964e-3489c57531ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24628bab46114856ae70ca60c86f984c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:14Z,use_quota=True,user_id='245d5b07ec5d41cbb77cb9faa962627e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Creating volume da237b02-7e74-498f-964e-3489c57531ed {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:19 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:19 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed 1073741824 Sep 11 23:19:19 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:19 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-fe4e6dd1-a7be-4f09-bbc4-771c37298ae8 tempest-VolumeDependencyTests-2084520405 None] Create snapshot completed successfully Sep 11 23:19:19 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed 1073741824" returned: 0 in 0.439s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:19 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed Sep 11 23:19:19 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:19 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed" returned: 0 in 0.290s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9ce6f2-18f9-477a-9855-df07675d6712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ad4d73cbbe4a3787e49f07a9e4e57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:15Z,use_quota=True,user_id='3cd0b4653c06420baa66b7f413d6e867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Creating volume 9b9ce6f2-18f9-477a-9855-df07675d6712 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:19 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8ae242-118f-44bb-a44f-0bae73f45e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da237b02-7e74-498f-964e-3489c57531ed', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:19 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 1073741824 Sep 11 23:19:19 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa86ef46-0365-404b-bb33-066f1bdb417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:19 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Volume volume-da237b02-7e74-498f-964e-3489c57531ed (da237b02-7e74-498f-964e-3489c57531ed): created successfully Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa86ef46-0365-404b-bb33-066f1bdb417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Flow 'volume_create_manager' (5d3e3256-9003-4be0-9c30-d6a87fd605b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:19 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-13ad3dfd-87f1-4c4c-b3fe-96bf5ae79220 tempest-CreateVolumesFromImageTest-421743407 None] Created volume successfully. Sep 11 23:19:20 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 1073741824" returned: 0 in 0.481s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:20 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 Sep 11 23:19:20 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-da237b02-7e74-498f-964e-3489c57531ed-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-da237b02-7e74-498f-964e-3489c57531ed-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-quobyte-da237b02-7e74-498f-964e-3489c57531ed" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-da237b02-7e74-498f-964e-3489c57531ed" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:20 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712" returned: 0 in 0.369s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3acb4e-9741-434b-8ae8-d00d48111cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7839b51371c14d758968f346c41098da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:16Z,use_quota=True,user_id='7a2cd8e7f9b742de9637461dd1769431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a824d2e3-3ecc-4242-8e0d-3c26d0ff83fa),volume_type_id=a824d2e3-3ecc-4242-8e0d-3c26d0ff83fa)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Creating volume 2c3acb4e-9741-434b-8ae8-d00d48111cd0 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:20 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26fe225-b7d1-43d8-9d81-2e78ed0ff1ca]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:20 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 1073741824 Sep 11 23:19:20 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Attempting download of 892049b6-0d3e-4090-b820-3927a0c0de72 ((None, [{'url': 'file:///opt/stack/data/glance/images/892049b6-0d3e-4090-b820-3927a0c0de72', 'metadata': {}}])) to volume 9b9ce6f2-18f9-477a-9855-df07675d6712. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Flow 'volume_create_manager' (bc2dee0b-b80d-477e-80c3-1a3aa622bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba9a927-d3d9-475c-882a-09626c7d8c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba9a927-d3d9-475c-882a-09626c7d8c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-681033931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826d6552-9df1-467b-9383-de39d4cc6ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6c9b4e7ec70419cac99291fddd4f08c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6801ab1b-76e4-4623-b4ac-d1edbb6d1260,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:21Z,use_quota=True,user_id='9bf7cde5f10b4d92a2cb864455d58fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65293850-5728-443d-83c9-f20591377fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65293850-5728-443d-83c9-f20591377fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4feaa6d-bc8d-48bc-a260-84674201fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4feaa6d-bc8d-48bc-a260-84674201fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '826d6552-9df1-467b-9383-de39d4cc6ec1', 'volume_name': 'volume-826d6552-9df1-467b-9383-de39d4cc6ec1', 'volume_size': 1, 'snapshot_id': '6801ab1b-76e4-4623-b4ac-d1edbb6d1260'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90db784-f158-4563-a47e-8056089ea215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed Sep 11 23:19:20 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90db784-f158-4563-a47e-8056089ea215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f549cb-24c1-4321-ad72-6ef46a4ea437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:20 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Volume 826d6552-9df1-467b-9383-de39d4cc6ec1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-826d6552-9df1-467b-9383-de39d4cc6ec1', 'volume_size': 1, 'snapshot_id': '6801ab1b-76e4-4623-b4ac-d1edbb6d1260'} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e007f3cb-7a00-43db-9e5a-8e08bf11caa0]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_892049b6-0d3e-4090-b820-3927a0c0de72_uvhbtg2d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:21 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_892049b6-0d3e-4090-b820-3927a0c0de72_uvhbtg2d Sep 11 23:19:21 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 1073741824" returned: 0 in 0.425s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed" returned: 0 in 0.465s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 Sep 11 23:19:21 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed Sep 11 23:19:21 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_892049b6-0d3e-4090-b820-3927a0c0de72_uvhbtg2d" returned: 0 in 0.389s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_892049b6-0d3e-4090-b820-3927a0c0de72_uvhbtg2d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_892049b6-0d3e-4090-b820-3927a0c0de72_uvhbtg2d Sep 11 23:19:21 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0" returned: 0 in 0.258s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.525s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-quobyte-6801ab1b-76e4-4623-b4ac-d1edbb6d1260-826d6552-9df1-467b-9383-de39d4cc6ec1" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:21 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da237b02-7e74-498f-964e-3489c57531ed" returned: 0 in 0.274s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-6801ab1b-76e4-4623-b4ac-d1edbb6d1260-826d6552-9df1-467b-9383-de39d4cc6ec1" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Creating volume 826d6552-9df1-467b-9383-de39d4cc6ec1 from snapshot 6801ab1b-76e4-4623-b4ac-d1edbb6d1260 {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-quobyte-826d6552-9df1-467b-9383-de39d4cc6ec1" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Attempting download of 112688d5-e2bb-46b3-beef-a88356cedfed ((None, [{'url': 'file:///opt/stack/data/glance/images/112688d5-e2bb-46b3-beef-a88356cedfed', 'metadata': {}}])) to volume 2c3acb4e-9741-434b-8ae8-d00d48111cd0. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-da237b02-7e74-498f-964e-3489c57531ed" released by "delete_volume" :: held 0.828s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-826d6552-9df1-467b-9383-de39d4cc6ec1" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] snapshot: 6801ab1b-76e4-4623-b4ac-d1edbb6d1260, volume: 826d6552-9df1-467b-9383-de39d4cc6ec1, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d6e7b1-d17c-4bd6-a760-959804339e67]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e95da46-819f-4836-8503-4046142e50e6]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_112688d5-e2bb-46b3-beef-a88356cedfed_2gtfttgb {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_892049b6-0d3e-4090-b820-3927a0c0de72_uvhbtg2d" returned: 1 in 0.401s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_892049b6-0d3e-4090-b820-3927a0c0de72_uvhbtg2d' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Created reservations ['f883e572-b13b-4440-b788-6b32607f2c5a', '6a480565-c58e-44f7-b3f3-c7918bd85fff', 'e0e2cf60-9e2e-46b3-bd77-2bbb2c434ac4', '1ec31d48-da7f-4597-94f0-6345ab8a8260'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7be27e2-c328-48cb-8d0c-111587b12226]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 Sep 11 23:19:21 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_112688d5-e2bb-46b3-beef-a88356cedfed_2gtfttgb Sep 11 23:19:21 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:21 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:21 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD Sep 11 23:19:21 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:21 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_112688d5-e2bb-46b3-beef-a88356cedfed_2gtfttgb" returned: 0 in 0.367s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_112688d5-e2bb-46b3-beef-a88356cedfed_2gtfttgb {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:22 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260" returned: 0 in 0.464s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8779cfd8-cd30-472e-9886-acaf26b7fa7c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:22 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.283s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:22 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Deleted volume successfully. Sep 11 23:19:22 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:22 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_112688d5-e2bb-46b3-beef-a88356cedfed_2gtfttgb Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-022ad885-df32-4248-9d4a-8f5244545e30 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-da237b02-7e74-498f-964e-3489c57531ed-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:22 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b Sep 11 23:19:22 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD Sep 11 23:19:22 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_112688d5-e2bb-46b3-beef-a88356cedfed_2gtfttgb" returned: 1 in 0.386s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_112688d5-e2bb-46b3-beef-a88356cedfed_2gtfttgb' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d8d705-b122-4c1b-9f7c-602e15fa73f3]: (4, 'raw') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:22 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] 892049b6-0d3e-4090-b820-3927a0c0de72 was raw, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:22 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" returned: 0 in 0.406s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:22 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 Sep 11 23:19:22 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 Sep 11 23:19:22 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD Sep 11 23:19:22 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-092a94d9-d02d-4fb4-8b24-ac088cbac98b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-092a94d9-d02d-4fb4-8b24-ac088cbac98b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-quobyte-092a94d9-d02d-4fb4-8b24-ac088cbac98b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-092a94d9-d02d-4fb4-8b24-ac088cbac98b" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:22 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD Sep 11 23:19:22 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c402bf7f-c2ca-41db-b205-e91d9bc43b71]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:23 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712" returned: 0 in 0.599s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:23 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_892049b6-0d3e-4090-b820-3927a0c0de72_fpbtes38devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:19:23 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 23:19:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:23 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 1G Sep 11 23:19:23 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:23 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b Sep 11 23:19:23 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:23 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD" returned: 1 in 0.701s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 11 23:19:23 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] 112688d5-e2bb-46b3-beef-a88356cedfed was raw, converting to qcow2 {{(pid=88026) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 11 23:19:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:23 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 Sep 11 23:19:23 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:24 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b" returned: 0 in 1.064s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:24 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 1G" returned: 0 in 1.024s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Downloaded image 892049b6-0d3e-4090-b820-3927a0c0de72 ((None, [{'url': 'file:///opt/stack/data/glance/images/892049b6-0d3e-4090-b820-3927a0c0de72', 'metadata': {}}])) to volume 9b9ce6f2-18f9-477a-9855-df07675d6712 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Temporary image 892049b6-0d3e-4090-b820-3927a0c0de72 for user 3cd0b4653c06420baa66b7f413d6e867 is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Marking volume 9b9ce6f2-18f9-477a-9855-df07675d6712 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Copying metadata from image 892049b6-0d3e-4090-b820-3927a0c0de72 to 9b9ce6f2-18f9-477a-9855-df07675d6712. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Creating volume glance metadata for volume 9b9ce6f2-18f9-477a-9855-df07675d6712 backed by image 892049b6-0d3e-4090-b820-3927a0c0de72 with: {'image_id': '892049b6-0d3e-4090-b820-3927a0c0de72', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '55920dce5db7629e34a0e6edade6278f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:19:24 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b Sep 11 23:19:24 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd48982f-73cc-44ac-a1d8-0f35bdc4b08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9ce6f2-18f9-477a-9855-df07675d6712', 'volume_size': 1, 'image_id': '892049b6-0d3e-4090-b820-3927a0c0de72', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/892049b6-0d3e-4090-b820-3927a0c0de72', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '55920dce5db7629e34a0e6edade6278f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30ad4d73cbbe4a3787e49f07a9e4e57b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2d3ac776ab788c7069a8f23c2b596e865a4eff2af49f689ea90c82dfe88f97c4521bee4a1c769966b59e1c7a81016653c5ae4e794364ceba8ee1264a4502ab8', 'id': '892049b6-0d3e-4090-b820-3927a0c0de72', 'created_at': datetime.datetime(2026, 9, 11, 21, 19, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 19, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/892049b6-0d3e-4090-b820-3927a0c0de72/file', 'properties': {}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650195a6-493f-4526-8081-a83ee2d9859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:24 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Volume volume-9b9ce6f2-18f9-477a-9855-df07675d6712 (9b9ce6f2-18f9-477a-9855-df07675d6712): created successfully Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650195a6-493f-4526-8081-a83ee2d9859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Flow 'volume_create_manager' (8521e057-43fe-4e8c-a962-61e66582c25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:24 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-eb9f0185-d08c-43dd-95bb-1f92fd5801bd tempest-VolumeImageDependencyTests-1262657886 None] Created volume successfully. Sep 11 23:19:25 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0" returned: 0 in 1.573s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_112688d5-e2bb-46b3-beef-a88356cedfed_ce2gk9sddevstack@QuobyteHD, size 0.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:19:25 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Converted 0.00 MB image at 0.00 MB/s Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:25 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-092a94d9-d02d-4fb4-8b24-ac088cbac98b" returned: 0 in 1.141s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:25 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 1G Sep 11 23:19:25 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-092a94d9-d02d-4fb4-8b24-ac088cbac98b" released by "delete_volume" :: held 2.313s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Created reservations ['a7681987-4ae9-487e-a32b-7c0c69fecab0', '6c69a578-8561-4736-bb1e-83348c0ca813', '0218b69c-14d7-409d-b49f-b6389e04fdbd', '1a3d1c36-15d7-4a24-b936-1c9022d9b22a'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Acquiring lock "cinder-9b9ce6f2-18f9-477a-9855-df07675d6712-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Lock "cinder-9b9ce6f2-18f9-477a-9855-df07675d6712-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Acquiring lock "cinder-quobyte-9b9ce6f2-18f9-477a-9855-df07675d6712" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Lock "cinder-quobyte-9b9ce6f2-18f9-477a-9855-df07675d6712" acquired by "delete_volume" :: waited 0.070s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35544eea-dd74-463e-9b4f-5a194804882d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:25 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:26 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:26 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 Sep 11 23:19:26 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:26 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 1G" returned: 0 in 1.129s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Downloaded image 112688d5-e2bb-46b3-beef-a88356cedfed ((None, [{'url': 'file:///opt/stack/data/glance/images/112688d5-e2bb-46b3-beef-a88356cedfed', 'metadata': {}}])) to volume 2c3acb4e-9741-434b-8ae8-d00d48111cd0 successfully. {{(pid=88026) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Temporary image 112688d5-e2bb-46b3-beef-a88356cedfed for user 7a2cd8e7f9b742de9637461dd1769431 is deleted. {{(pid=88026) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.volume.volume_utils [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Marking volume 2c3acb4e-9741-434b-8ae8-d00d48111cd0 as bootable. {{(pid=88026) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Copying metadata from image 112688d5-e2bb-46b3-beef-a88356cedfed to 2c3acb4e-9741-434b-8ae8-d00d48111cd0. {{(pid=88026) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Creating volume glance metadata for volume 2c3acb4e-9741-434b-8ae8-d00d48111cd0 backed by image 112688d5-e2bb-46b3-beef-a88356cedfed with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '112688d5-e2bb-46b3-beef-a88356cedfed', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9e5c914fdd30ad3a02c30400bde46448', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88026) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 11 23:19:26 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.703s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Deleted volume successfully. Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-9bf8c869-571d-4bfa-988c-4d2061ec0c50-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ee2697-b85d-48b2-8c10-985d05b74f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0', 'volume_size': 1, 'image_id': '112688d5-e2bb-46b3-beef-a88356cedfed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/112688d5-e2bb-46b3-beef-a88356cedfed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e5c914fdd30ad3a02c30400bde46448', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7839b51371c14d758968f346c41098da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec02034dc4be83865ed64574e90ca65c39c007d70b92d5f104f1c7fb152c012a800a7ded4781eec4aadff1da221b63727237ff4d3c01bd9bee707d828f959d09', 'id': '112688d5-e2bb-46b3-beef-a88356cedfed', 'created_at': datetime.datetime(2026, 9, 11, 21, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 19, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/112688d5-e2bb-46b3-beef-a88356cedfed/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c6794a-d5d0-4757-9d13-81dcd11a1880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-9bf8c869-571d-4bfa-988c-4d2061ec0c50-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-65d90a51-d521-4761-a823-22e5db7e5e8b tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-092a94d9-d02d-4fb4-8b24-ac088cbac98b-delete_volume" released by "delete_volume" :: held 3.901s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:26 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Volume volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 (2c3acb4e-9741-434b-8ae8-d00d48111cd0): created successfully Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c6794a-d5d0-4757-9d13-81dcd11a1880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Flow 'volume_create_manager' (169a676b-302b-4580-8948-670e8e46fafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-22c65702-2ed3-4e2e-a85b-707823661f92 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Created volume successfully. Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-quobyte-9bf8c869-571d-4bfa-988c-4d2061ec0c50" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-9bf8c869-571d-4bfa-988c-4d2061ec0c50" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a1a10c-462d-4f7b-8301-3ef5696fb35e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:27 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 Sep 11 23:19:27 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:27 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712" returned: 0 in 1.300s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:27 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712 Sep 11 23:19:27 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Acquiring lock "cinder-2c3acb4e-9741-434b-8ae8-d00d48111cd0-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "cinder-2c3acb4e-9741-434b-8ae8-d00d48111cd0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:27 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50" returned: 0 in 0.779s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:27 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9b9ce6f2-18f9-477a-9855-df07675d6712" returned: 0 in 0.604s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:27 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50 Sep 11 23:19:27 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Lock "cinder-quobyte-9b9ce6f2-18f9-477a-9855-df07675d6712" released by "delete_volume" :: held 2.103s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Acquiring lock "cinder-quobyte-2c3acb4e-9741-434b-8ae8-d00d48111cd0" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "cinder-quobyte-2c3acb4e-9741-434b-8ae8-d00d48111cd0" acquired by "delete_volume" :: waited 0.077s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb3e114-b216-45ff-83ba-ddcc264380f0]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Created reservations ['c72bee10-977f-4d64-b608-742574a01442', '7262eb84-faa3-435d-8bc6-7856b76895b9', 'caf55ecf-d4d2-4184-a909-8c8bb32307d6', '353002a7-871a-410c-b46a-45d29b11dde2'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:28 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9bf8c869-571d-4bfa-988c-4d2061ec0c50" returned: 0 in 0.515s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:28 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 Sep 11 23:19:28 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-9bf8c869-571d-4bfa-988c-4d2061ec0c50" released by "delete_volume" :: held 1.422s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Created reservations ['49a76f34-6818-4f51-9ee2-f4030997cf22', 'd50bf6e4-0af6-453b-aef0-f1e44d900da6', '861fcba2-e138-43ba-81aa-45c06212d40a', '077db3c8-4b3d-4253-b5cc-eef9e38207f8'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:28 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:28 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:28 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0" returned: 0 in 0.772s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:28 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1" returned: 0 in 6.470s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:19:28 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Converted 1024.00 MB image at 158.19 MB/s Sep 11 23:19:28 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 is being set with open permissions: ugo+rw Sep 11 23:19:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:28 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:28 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:28 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0 Sep 11 23:19:28 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:28 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 Sep 11 23:19:28 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:29 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.470s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Deleted volume successfully. Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cf080562-75f6-4219-835e-3a08a1d7b850 tempest-VolumeImageDependencyTests-1262657886 None] Lock "cinder-9b9ce6f2-18f9-477a-9855-df07675d6712-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:29 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.350s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Deleted volume successfully. Sep 11 23:19:29 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1" returned: 0 in 0.352s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2c3acb4e-9741-434b-8ae8-d00d48111cd0" returned: 0 in 0.375s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "cinder-quobyte-2c3acb4e-9741-434b-8ae8-d00d48111cd0" released by "delete_volume" :: held 1.261s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-826d6552-9df1-467b-9383-de39d4cc6ec1" released by "_copy_volume_from_snapshot" :: held 7.838s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-627a6ae2-b102-43e8-b64a-26c38af46e82 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-9bf8c869-571d-4bfa-988c-4d2061ec0c50-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-quobyte-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-6801ab1b-76e4-4623-b4ac-d1edbb6d1260-826d6552-9df1-467b-9383-de39d4cc6ec1" released by "_create_volume_from_snapshot" :: held 7.952s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.996s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f549cb-24c1-4321-ad72-6ef46a4ea437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826d6552-9df1-467b-9383-de39d4cc6ec1', 'volume_size': 1, 'snapshot_id': '6801ab1b-76e4-4623-b4ac-d1edbb6d1260'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed3019a-2e17-45c4-bd55-528cb090e80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0" acquired by "delete_volume" :: waited 0.052s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Created reservations ['ecda8670-ab11-42a9-abb8-7b7bdbb3a39f', '5443efd2-d8d6-4fe9-b67c-59c7f2c938da', '35c76c65-ec17-441d-b5bc-7146c7cce45a', '8019c04f-3233-46f0-8b2a-795ff699f979'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa92c21e-c25c-4a36-a891-9ff4d57fc380]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:29 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Volume volume-826d6552-9df1-467b-9383-de39d4cc6ec1 (826d6552-9df1-467b-9383-de39d4cc6ec1): created successfully Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed3019a-2e17-45c4-bd55-528cb090e80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Flow 'volume_create_manager' (bc2dee0b-b80d-477e-80c3-1a3aa622bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f132e8f0-d792-4ee0-88c0-afb0080036fd tempest-VolumeDependencyTests-2084520405 None] Created volume successfully. Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:29 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 Sep 11 23:19:29 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:29 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:29 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-6801ab1b-76e4-4623-b4ac-d1edbb6d1260-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-6801ab1b-76e4-4623-b4ac-d1edbb6d1260-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-quobyte-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-quobyte-6801ab1b-76e4-4623-b4ac-d1edbb6d1260" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-6801ab1b-76e4-4623-b4ac-d1edbb6d1260" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Deleting offline snapshot 6801ab1b-76e4-4623-b4ac-d1edbb6d1260 of volume 9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] snapshot_file for this snap is: volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c2db77-a03a-40bd-9abe-1bb938737866]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0" returned: 0 in 0.591s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 Sep 11 23:19:30 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.458s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Deleted volume successfully. Sep 11 23:19:30 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0 Sep 11 23:19:30 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-715319fd-9121-4846-b374-6205092c64a9 tempest-VolumeAndVolumeTypeFromImageTest-1952479232 None] Lock "cinder-2c3acb4e-9741-434b-8ae8-d00d48111cd0-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:30 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0" returned: 0 in 0.436s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260" returned: 0 in 0.601s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0" released by "delete_volume" :: held 1.118s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb95b096-854d-4f5c-b83e-fd845f49b7ee]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Created reservations ['5d6df8ef-c213-4ba5-a968-4b0d5c652eb5', '0ac3f3db-8a98-45a1-9430-9e3704471b86', '60d69a74-f8d9-435d-ac9f-c9415f8e6149', 'd2b9f530-4f6b-4a85-9e53-4c49bb30030e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:30 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b Sep 11 23:19:30 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:30 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:30 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:31 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.331s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:31 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Deleted volume successfully. Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c761d21b-32b9-4e9b-b890-1336ccca2035 tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-d5dfe7e9-49dd-47d1-b9d8-acba6c23c5c0-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:31 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" returned: 0 in 0.712s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:31 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 Sep 11 23:19:31 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-076d49b7-be2f-475b-b317-89a5aaf050ba-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-076d49b7-be2f-475b-b317-89a5aaf050ba-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "cinder-quobyte-076d49b7-be2f-475b-b317-89a5aaf050ba" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-076d49b7-be2f-475b-b317-89a5aaf050ba" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75718ab-4883-46bf-a1c7-e753ddee2837]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:31 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260" returned: 0 in 0.548s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:31 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba Sep 11 23:19:31 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:31 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260 Sep 11 23:19:31 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:32 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b.6801ab1b-76e4-4623-b4ac-d1edbb6d1260" returned: 0 in 0.336s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:32 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba" returned: 0 in 0.499s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-6801ab1b-76e4-4623-b4ac-d1edbb6d1260" released by "_delete_snapshot" :: held 2.370s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" released by "delete_snapshot" :: held 2.412s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:32 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba Sep 11 23:19:32 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Created reservations ['fc667a5a-6dc6-4814-94da-ea8be39568d3', 'aad5f5c3-8288-4d21-8525-c1cc6e18a520', '1152e175-9aad-432a-a9c1-177cd30b7249', 'dc751b16-683f-4d63-ab6c-cc3c8bf17e60'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:32 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Delete snapshot completed successfully. Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-216d7a21-476b-4a68-b972-f85d22525f6a tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-6801ab1b-76e4-4623-b4ac-d1edbb6d1260-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:32 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-076d49b7-be2f-475b-b317-89a5aaf050ba" returned: 0 in 0.339s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-quobyte-076d49b7-be2f-475b-b317-89a5aaf050ba" released by "delete_volume" :: held 0.895s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Created reservations ['321f2ce4-1e4e-4775-9e70-f22548dc8909', '72c79919-4046-46e4-955d-3e82b54f6999', 'bbda71bb-374b-441a-952f-e1959fee29be', 'b604f1fb-db9e-423f-8908-308bb5915c46'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:32 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:32 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:33 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.305s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:33 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Deleted volume successfully. Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-9ec87453-b1d5-49ec-bb8e-bd855a2f996b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8c5484fd-85a6-4ee4-90f2-36add1a165bb tempest-CreateVolumesFromImageTest-421743407 None] Lock "cinder-076d49b7-be2f-475b-b317-89a5aaf050ba-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-9ec87453-b1d5-49ec-bb8e-bd855a2f996b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-quobyte-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[659ceea1-e8bc-45cc-8783-4eb58d70397a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:33 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b Sep 11 23:19:33 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:33 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" returned: 0 in 0.595s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:33 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b Sep 11 23:19:33 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:34 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" returned: 0 in 0.402s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-9ec87453-b1d5-49ec-bb8e-bd855a2f996b" released by "delete_volume" :: held 1.078s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Created reservations ['84020f25-31f7-4ac0-9d23-cd42175be193', '09ded243-f599-444b-9b26-8acc88862b46', '1d916ce2-0cd2-4612-996f-56b153f7f1ac', '334398b3-a1de-42f3-a836-463d414b5899'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:34 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:34 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:34 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.337s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Deleted volume successfully. Sep 11 23:19:34 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-310d3736-07bc-48eb-a7b4-3916941d6a30 tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-9ec87453-b1d5-49ec-bb8e-bd855a2f996b-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-826d6552-9df1-467b-9383-de39d4cc6ec1-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-826d6552-9df1-467b-9383-de39d4cc6ec1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "cinder-quobyte-826d6552-9df1-467b-9383-de39d4cc6ec1" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-826d6552-9df1-467b-9383-de39d4cc6ec1" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04102a59-5d74-400b-abe2-fe51fd0608c2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:35 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 Sep 11 23:19:35 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:35 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1" returned: 0 in 0.422s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:36 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1 Sep 11 23:19:36 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:36 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-826d6552-9df1-467b-9383-de39d4cc6ec1" returned: 0 in 0.303s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-quobyte-826d6552-9df1-467b-9383-de39d4cc6ec1" released by "delete_volume" :: held 0.785s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Created reservations ['c4d06eae-4918-488d-877e-02b0fbb8d530', '83b23888-9013-4159-9e78-b592e8936567', 'd4345340-fa89-45d0-b2b1-94911aa715fe', 'f676f0e6-39b1-484e-b3a2-c240a4b31eef'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (ecaacd7d-da78-437a-8cad-0715d94f9d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f09ac-13c5-4db9-b5c8-3797b13cf0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f09ac-13c5-4db9-b5c8-3797b13cf0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665564370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8735ab-d122-4d6c-8079-e2b8e4a7fec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:36Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dcb08d-da04-41f2-95ad-b84e1f2f3777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3dcb08d-da04-41f2-95ad-b84e1f2f3777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56223115-14ad-474d-bb3d-401903fe2163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56223115-14ad-474d-bb3d-401903fe2163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8735ab-d122-4d6c-8079-e2b8e4a7fec5', 'volume_name': 'volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b166154-0baf-4431-9042-6d36659100a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b166154-0baf-4431-9042-6d36659100a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2acfb91-762d-431a-a3b0-bb525b98ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:36 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume 2d8735ab-d122-4d6c-8079-e2b8e4a7fec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5', 'volume_size': 1} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1665564370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8735ab-d122-4d6c-8079-e2b8e4a7fec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:36Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Creating volume 2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:36 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:36 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 1073741824 Sep 11 23:19:36 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:36 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:36 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:37 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.340s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Deleted volume successfully. Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-2fd0d5e8-ad91-49b0-90f8-f2bae4a8e73d tempest-VolumeDependencyTests-2084520405 None] Lock "cinder-826d6552-9df1-467b-9383-de39d4cc6ec1-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:37 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 1073741824" returned: 0 in 0.624s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:37 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 Sep 11 23:19:37 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:37 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2acfb91-762d-431a-a3b0-bb525b98ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3084276-373b-4848-8291-099e20b87b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:37 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 (2d8735ab-d122-4d6c-8079-e2b8e4a7fec5): created successfully Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3084276-373b-4848-8291-099e20b87b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (ecaacd7d-da78-437a-8cad-0715d94f9d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6adedab4-9b60-4f8a-88a7-fcee311bfbaa tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created volume successfully. Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (3943134e-8172-438d-becb-fed2513cc991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579da08e-9291-43df-a50a-1e8dbb0439d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579da08e-9291-43df-a50a-1e8dbb0439d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-23463717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff98cb3-138c-435f-903e-a4e013fa262b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:38Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b866b6-4349-41a0-9b54-3e10cce748a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b866b6-4349-41a0-9b54-3e10cce748a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75486b37-18fc-4345-9d42-6cac88185038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75486b37-18fc-4345-9d42-6cac88185038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff98cb3-138c-435f-903e-a4e013fa262b', 'volume_name': 'volume-cff98cb3-138c-435f-903e-a4e013fa262b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e825e54-2575-47ca-a48a-9932df3faa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e825e54-2575-47ca-a48a-9932df3faa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be332313-558e-4cca-9f60-e5b912b57711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:38 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume cff98cb3-138c-435f-903e-a4e013fa262b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff98cb3-138c-435f-903e-a4e013fa262b', 'volume_size': 1} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-23463717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff98cb3-138c-435f-903e-a4e013fa262b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:38Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Creating volume cff98cb3-138c-435f-903e-a4e013fa262b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:38 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:38 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b 1073741824 Sep 11 23:19:38 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:39 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b 1073741824" returned: 0 in 0.706s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:39 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b Sep 11 23:19:39 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:39 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b" returned: 0 in 0.249s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.396s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be332313-558e-4cca-9f60-e5b912b57711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff98cb3-138c-435f-903e-a4e013fa262b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f67dac3-adf3-4947-8015-7103a27f7488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Creating offline snapshot a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 of volume 2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:39 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume volume-cff98cb3-138c-435f-903e-a4e013fa262b (cff98cb3-138c-435f-903e-a4e013fa262b): created successfully Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f67dac3-adf3-4947-8015-7103a27f7488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (3943134e-8172-438d-becb-fed2513cc991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aab6b1-3185-49c0-92b1-6de9986c1975]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:39 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c0bd2130-9951-4ebf-ae99-7d06cced981c tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created volume successfully. Sep 11 23:19:39 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 Sep 11 23:19:39 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:39 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:39 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 1G Sep 11 23:19:39 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:40 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 1G" returned: 0 in 0.478s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:40 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 Sep 11 23:19:40 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:40 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3" returned: 0 in 0.481s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:40 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 is being set with open permissions: ugo+rw Sep 11 23:19:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:40 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 Sep 11 23:19:40 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:40 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (5862fee0-3377-43c7-bd3a-a4b62e0c9c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db638f0a-1678-42df-ae73-fcf1648aad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db638f0a-1678-42df-ae73-fcf1648aad8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-509022108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb1c009-206f-47d0-a93f-5b088e48cc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:41Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6116c7f9-2fbd-4db3-b045-c0aa5c9b5423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6116c7f9-2fbd-4db3-b045-c0aa5c9b5423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d96f253-b4a3-4344-8d6e-dc2623d494c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d96f253-b4a3-4344-8d6e-dc2623d494c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb1c009-206f-47d0-a93f-5b088e48cc50', 'volume_name': 'volume-9cb1c009-206f-47d0-a93f-5b088e48cc50', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d11e75-8af9-4fd2-b5b2-0be40585672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d11e75-8af9-4fd2-b5b2-0be40585672f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a850b631-df4d-4c2e-8319-9f49c4d328f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume 9cb1c009-206f-47d0-a93f-5b088e48cc50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb1c009-206f-47d0-a93f-5b088e48cc50', 'volume_size': 1} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:41 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Flow 'volume_create_manager' (d349dc6c-915d-4d9c-a233-d4e2e12337ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637b9faa-eea8-4d4d-a9c7-096d6e1da555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637b9faa-eea8-4d4d-a9c7-096d6e1da555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03e0ace-0a94-4849-a2d1-0133f6822b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba6fd72d8744860a062b22173bfbe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:41Z,use_quota=True,user_id='2e221184d9a54bb5a22811b9b78f5c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a4ee2b-b710-4503-9c2b-6b9cefc8a9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a4ee2b-b710-4503-9c2b-6b9cefc8a9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23be66bb-89c9-4b36-9890-62ca62f1bb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23be66bb-89c9-4b36-9890-62ca62f1bb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03e0ace-0a94-4849-a2d1-0133f6822b12', 'volume_name': 'volume-e03e0ace-0a94-4849-a2d1-0133f6822b12', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c97852-9229-44f4-a3d5-72c39d9d0e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c97852-9229-44f4-a3d5-72c39d9d0e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2977a908-6a6a-4a8c-a6aa-c6838811c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Volume e03e0ace-0a94-4849-a2d1-0133f6822b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03e0ace-0a94-4849-a2d1-0133f6822b12', 'volume_size': 1} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:41 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.info Sep 11 23:19:41 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (64916747-4881-4b1f-aec6-2af3a7313ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6165f22c-ee44-41a5-98fd-d88f0722185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6165f22c-ee44-41a5-98fd-d88f0722185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601482875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:41Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c7b4c8-7a5e-4733-98b6-4e9eaaf1a57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c7b4c8-7a5e-4733-98b6-4e9eaaf1a57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a4e4df-6630-47f6-a077-73cd91224094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a4e4df-6630-47f6-a077-73cd91224094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac', 'volume_name': 'volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd610c2-7736-40f1-9ada-0e760117f3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd610c2-7736-40f1-9ada-0e760117f3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55fb73e-e21d-4351-ad21-8e4094b25cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac', 'volume_size': 1} Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:41 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.info" returned: 0 in 0.354s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:41 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.info is being set with open permissions: ugo+rw Sep 11 23:19:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:41 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.info Sep 11 23:19:41 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:42 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (21592d1e-8d83-42c1-b767-1d5351f18047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb06b75-4e86-4861-ad5e-8cf0f73f72ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.info" returned: 0 in 0.382s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.980s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-509022108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb1c009-206f-47d0-a93f-5b088e48cc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:41Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Creating volume 9cb1c009-206f-47d0-a93f-5b088e48cc50 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:42 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb06b75-4e86-4861-ad5e-8cf0f73f72ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558557154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e37a2f-ad9d-49b8-803e-f98cb2e79f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:42Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 1073741824 Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6e3cdc-52c5-40f6-994d-89e0cc0b2c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6e3cdc-52c5-40f6-994d-89e0cc0b2c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99470dc-f261-4f22-b310-dc6668a20186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99470dc-f261-4f22-b310-dc6668a20186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e37a2f-ad9d-49b8-803e-f98cb2e79f88', 'volume_name': 'volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4a80ea-01f5-4b29-9770-89bd36923bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4a80ea-01f5-4b29-9770-89bd36923bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ed14e3-f59d-4b00-bab7-a2995d652dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume 19e37a2f-ad9d-49b8-803e-f98cb2e79f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88', 'volume_size': 1} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a7e09b11-e4d2-4500-81c7-861b851abb0a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Create snapshot completed successfully Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (62132b7f-7241-42c3-86d4-bf79c464ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473eb25-1a5c-4348-94b0-d566305035ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (859d0fe7-95af-4f5d-8c44-e4aab1ad4f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8b0575-143c-411c-a425-40616305ffae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473eb25-1a5c-4348-94b0-d566305035ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1091741885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603b36c9-1a8d-4c7c-b443-fcb2e987348d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:42Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f947e5f7-f73f-407e-92f3-234747058019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f947e5f7-f73f-407e-92f3-234747058019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f46a86-a085-40be-82dd-768456f215ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f46a86-a085-40be-82dd-768456f215ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '603b36c9-1a8d-4c7c-b443-fcb2e987348d', 'volume_name': 'volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76cbc32-94a0-4a75-9ede-5d5f66a01983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76cbc32-94a0-4a75-9ede-5d5f66a01983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e796e84-c203-4e97-8110-deccb4689cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Volume 603b36c9-1a8d-4c7c-b443-fcb2e987348d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d', 'volume_size': 1} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8b0575-143c-411c-a425-40616305ffae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1905383534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85ffcbe-7768-453f-a1d6-4cf61277bc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:43Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a648bf7-7da5-4de5-a101-35a77c70c28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a648bf7-7da5-4de5-a101-35a77c70c28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c688456-e64f-4464-b0f7-59a2b7bccb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c688456-e64f-4464-b0f7-59a2b7bccb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c85ffcbe-7768-453f-a1d6-4cf61277bc77', 'volume_name': 'volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cce289-9961-415e-8085-d96043db4e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cce289-9961-415e-8085-d96043db4e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a73957-bd6d-4e59-aa5e-c280ee31dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume c85ffcbe-7768-453f-a1d6-4cf61277bc77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77', 'volume_size': 1} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 1073741824" returned: 0 in 0.591s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:42 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 Sep 11 23:19:42 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (ba61624c-c618-4595-b777-4faffbc30199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206a7f07-79a7-4229-949e-ed4af81afa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206a7f07-79a7-4229-949e-ed4af81afa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208250982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecacc7e-15e8-47f1-8238-45668a5e1107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:43Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113e182f-a48d-4833-9141-8e919bf61fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113e182f-a48d-4833-9141-8e919bf61fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ec589e-e4eb-4a72-8684-451460a79c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ec589e-e4eb-4a72-8684-451460a79c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ecacc7e-15e8-47f1-8238-45668a5e1107', 'volume_name': 'volume-3ecacc7e-15e8-47f1-8238-45668a5e1107', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac164d7-9998-462b-8c3a-c2d3c9251b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac164d7-9998-462b-8c3a-c2d3c9251b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aafda8-8fed-4d73-a244-93a494764745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume 3ecacc7e-15e8-47f1-8238-45668a5e1107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ecacc7e-15e8-47f1-8238-45668a5e1107', 'volume_size': 1} Sep 11 23:19:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:43 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50" returned: 0 in 0.281s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03e0ace-0a94-4849-a2d1-0133f6822b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba6fd72d8744860a062b22173bfbe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:41Z,use_quota=True,user_id='2e221184d9a54bb5a22811b9b78f5c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Creating volume e03e0ace-0a94-4849-a2d1-0133f6822b12 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:43 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a850b631-df4d-4c2e-8319-9f49c4d328f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb1c009-206f-47d0-a93f-5b088e48cc50', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:43 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 1073741824 Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae45e57b-38ed-4ebb-a61b-7261636c49a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:43 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 (9cb1c009-206f-47d0-a93f-5b088e48cc50): created successfully Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae45e57b-38ed-4ebb-a61b-7261636c49a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (5862fee0-3377-43c7-bd3a-a4b62e0c9c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:43 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-65da014e-da6d-4d25-bfda-cf260b52b02a tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created volume successfully. Sep 11 23:19:43 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 1073741824" returned: 0 in 0.559s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (350fff16-644e-4582-af72-4c81b8556e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473941c-8fed-48c6-81a8-ba98e3520b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473941c-8fed-48c6-81a8-ba98e3520b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-414317100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6d3d80-e213-47c7-99e2-f6a206ac07ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:44Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fcc8bc-d60d-4e2a-a1e0-5597aa7ea229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fcc8bc-d60d-4e2a-a1e0-5597aa7ea229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3527d5c4-9ba8-427f-a1a5-f46476c5fb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3527d5c4-9ba8-427f-a1a5-f46476c5fb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa6d3d80-e213-47c7-99e2-f6a206ac07ec', 'volume_name': 'volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c95d8e9-3aaa-4134-990b-f9c81dc5e91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c95d8e9-3aaa-4134-990b-f9c81dc5e91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6ad649-3b58-4499-83e2-bba6c5c14211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:43 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume aa6d3d80-e213-47c7-99e2-f6a206ac07ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec', 'volume_size': 1} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:43 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 Sep 11 23:19:43 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (de086bc5-d8fc-4f81-a129-231e2819e786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848f5ef3-a515-4d36-8582-a108501fb0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12" returned: 0 in 0.315s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.441s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601482875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:41Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Creating volume e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:44 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848f5ef3-a515-4d36-8582-a108501fb0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111960382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81abfacc-53c4-4db7-8730-e02befe775cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:44Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8848b47a-3478-44fb-a28b-84c9ad1ffe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8848b47a-3478-44fb-a28b-84c9ad1ffe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b095e947-d6f2-4eea-9b75-618358b976fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac 1073741824 Sep 11 23:19:44 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b095e947-d6f2-4eea-9b75-618358b976fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81abfacc-53c4-4db7-8730-e02befe775cb', 'volume_name': 'volume-81abfacc-53c4-4db7-8730-e02befe775cb', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50240cd1-b468-4c6c-89d7-3b1874845fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50240cd1-b468-4c6c-89d7-3b1874845fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d871b08f-931d-48ee-9ee3-4f1e07a48f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume 81abfacc-53c4-4db7-8730-e02befe775cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81abfacc-53c4-4db7-8730-e02befe775cb', 'volume_size': 1} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2977a908-6a6a-4a8c-a6aa-c6838811c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03e0ace-0a94-4849-a2d1-0133f6822b12', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7e2ba4-bba4-457f-8174-27510cf27178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Volume volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 (e03e0ace-0a94-4849-a2d1-0133f6822b12): created successfully Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7e2ba4-bba4-457f-8174-27510cf27178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Flow 'volume_create_manager' (d349dc6c-915d-4d9c-a233-d4e2e12337ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-846a748d-0ea6-4357-8004-ed03113dcd7e tempest-CinderUnicodeTest-2127228511 None] Created volume successfully. Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (98e724a2-10fe-40bd-af71-644881d7252a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e60e3a-14b9-45d5-b1bb-ab1509de6ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e60e3a-14b9-45d5-b1bb-ab1509de6ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379445775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad554e89-9881-40f6-9a62-adf6c24f1ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:44Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb64d0d-880a-40a8-be29-c4819cf05730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb64d0d-880a-40a8-be29-c4819cf05730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8e03e8-bc1e-427d-9480-5d210f57c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8e03e8-bc1e-427d-9480-5d210f57c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad554e89-9881-40f6-9a62-adf6c24f1ce1', 'volume_name': 'volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec7ea1e-deeb-4822-b3a6-4d6a3c5ac358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec7ea1e-deeb-4822-b3a6-4d6a3c5ac358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7115ac4b-5b53-4215-84ff-7198599c466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume ad554e89-9881-40f6-9a62-adf6c24f1ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1', 'volume_size': 1} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:44 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac 1073741824" returned: 0 in 0.567s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:44 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac Sep 11 23:19:44 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (0a8d3c0c-852f-4e7a-84f7-3652a8cc919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9def5f77-c17c-45fd-a540-7d0d9ab243a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9def5f77-c17c-45fd-a540-7d0d9ab243a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-437076726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb81e804-7154-4b57-9e7c-8b62035beea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:45Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f2274d-dc96-4a01-9972-d914f533b190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f2274d-dc96-4a01-9972-d914f533b190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dae8eae-a20d-49ec-bfd6-4b5a1a8dad70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dae8eae-a20d-49ec-bfd6-4b5a1a8dad70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb81e804-7154-4b57-9e7c-8b62035beea6', 'volume_name': 'volume-cb81e804-7154-4b57-9e7c-8b62035beea6', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e20dc46-05ec-4b7c-9c60-958531701d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e20dc46-05ec-4b7c-9c60-958531701d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd614d2-2fa0-43d7-bcce-873a9464a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:44 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume cb81e804-7154-4b57-9e7c-8b62035beea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb81e804-7154-4b57-9e7c-8b62035beea6', 'volume_size': 1} Sep 11 23:19:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:45 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.779s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558557154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e37a2f-ad9d-49b8-803e-f98cb2e79f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:42Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Creating volume 19e37a2f-ad9d-49b8-803e-f98cb2e79f88 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:45 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55fb73e-e21d-4351-ad21-8e4094b25cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3813ce6-25e7-4582-8288-29fbd2713fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 1073741824 Sep 11 23:19:45 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac (e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac): created successfully Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3813ce6-25e7-4582-8288-29fbd2713fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (64916747-4881-4b1f-aec6-2af3a7313ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cb57a804-dd17-4651-866a-a5240a9468fa tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created volume successfully. Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (bd91e45c-2b53-4331-a63b-eb93dbfc2b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1511a900-3d45-4d96-b5a5-2badd63f6742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1511a900-3d45-4d96-b5a5-2badd63f6742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913481089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f302822-c3aa-4016-a073-6f2441d18b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:45Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef52543-dbf3-4324-98c8-14ef551a3e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef52543-dbf3-4324-98c8-14ef551a3e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549d2fb9-b35e-4f67-a1cd-267b2b78a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549d2fb9-b35e-4f67-a1cd-267b2b78a030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f302822-c3aa-4016-a073-6f2441d18b46', 'volume_name': 'volume-2f302822-c3aa-4016-a073-6f2441d18b46', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1467de8a-2372-434c-9708-639588b9bd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1467de8a-2372-434c-9708-639588b9bd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45a3a9d-b883-4cba-9a43-9bb6ab95d655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume 2f302822-c3aa-4016-a073-6f2441d18b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f302822-c3aa-4016-a073-6f2441d18b46', 'volume_size': 1} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:45 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 1073741824" returned: 0 in 0.505s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:45 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 Sep 11 23:19:45 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:45 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88" returned: 0 in 0.293s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.167s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1091741885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603b36c9-1a8d-4c7c-b443-fcb2e987348d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:42Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Creating volume 603b36c9-1a8d-4c7c-b443-fcb2e987348d {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:45 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:19:45 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d 1073741824 Sep 11 23:19:45 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Flow 'volume_create_manager' (8c5517db-1e05-4266-93a0-4c128009478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a68465-57ac-4f84-8230-87a7d699cb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ed14e3-f59d-4b00-bab7-a2995d652dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021598dc-cdca-4f8c-996c-e94ce1b3f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a68465-57ac-4f84-8230-87a7d699cb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1616676980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da331884-6382-4bc0-800c-0333889fa8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba6fd72d8744860a062b22173bfbe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:46Z,use_quota=True,user_id='2e221184d9a54bb5a22811b9b78f5c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b784591-4e46-4913-9d79-dc0306cc9868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b784591-4e46-4913-9d79-dc0306cc9868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b30b1cb-34c0-4a01-b8ed-f88c35fb6aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b30b1cb-34c0-4a01-b8ed-f88c35fb6aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da331884-6382-4bc0-800c-0333889fa8c2', 'volume_name': 'volume-da331884-6382-4bc0-800c-0333889fa8c2', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25f302f-b025-4a2c-848a-b46f70f115a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25f302f-b025-4a2c-848a-b46f70f115a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30086a0c-6a99-493b-8323-b6ecec886b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:46 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Volume da331884-6382-4bc0-800c-0333889fa8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da331884-6382-4bc0-800c-0333889fa8c2', 'volume_size': 1} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:46 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 (19e37a2f-ad9d-49b8-803e-f98cb2e79f88): created successfully Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021598dc-cdca-4f8c-996c-e94ce1b3f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (21592d1e-8d83-42c1-b767-1d5351f18047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:46 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-58b52aeb-6f0f-4f27-805c-9922a0e84555 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created volume successfully. Sep 11 23:19:46 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d 1073741824" returned: 0 in 0.451s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:46 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d Sep 11 23:19:46 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:46 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d" returned: 0 in 0.249s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.867s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1905383534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85ffcbe-7768-453f-a1d6-4cf61277bc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:43Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Creating volume c85ffcbe-7768-453f-a1d6-4cf61277bc77 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:46 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:46 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 1073741824 Sep 11 23:19:46 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e796e84-c203-4e97-8110-deccb4689cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e9f28c-6e0f-4f9b-806b-21f73a6ef1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:46 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Volume volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d (603b36c9-1a8d-4c7c-b443-fcb2e987348d): created successfully Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e9f28c-6e0f-4f9b-806b-21f73a6ef1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (62132b7f-7241-42c3-86d4-bf79c464ba14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:46 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5bd0052e-ae59-454d-aef7-c5a87a5f9869 tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:19:47 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 1073741824" returned: 0 in 0.431s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:47 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 Sep 11 23:19:47 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:47 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77" returned: 0 in 0.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.431s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208250982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecacc7e-15e8-47f1-8238-45668a5e1107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b959b89450774ea5a2d8b1d2c4c2f10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:43Z,use_quota=True,user_id='60e9479beeec4f8783413a1dd4f2ab4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Creating volume 3ecacc7e-15e8-47f1-8238-45668a5e1107 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:47 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a73957-bd6d-4e59-aa5e-c280ee31dea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:47 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 1073741824 Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cbe6a6-78ef-45a5-90e1-bfb671b9d52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:47 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:47 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 (c85ffcbe-7768-453f-a1d6-4cf61277bc77): created successfully Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cbe6a6-78ef-45a5-90e1-bfb671b9d52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (859d0fe7-95af-4f5d-8c44-e4aab1ad4f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3cf4ee36-6b37-4b23-a831-4fed84543ca8 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created volume successfully. Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:47 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 1073741824" returned: 0 in 0.490s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:47 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 Sep 11 23:19:47 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:48 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107" returned: 0 in 0.250s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.381s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-414317100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6d3d80-e213-47c7-99e2-f6a206ac07ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:44Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Creating volume aa6d3d80-e213-47c7-99e2-f6a206ac07ec {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:48 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aafda8-8fed-4d73-a244-93a494764745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ecacc7e-15e8-47f1-8238-45668a5e1107', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:48 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec 1073741824 Sep 11 23:19:48 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99580c4c-b5b9-42c5-9278-d33bb78f5762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:48 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Volume volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 (3ecacc7e-15e8-47f1-8238-45668a5e1107): created successfully Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99580c4c-b5b9-42c5-9278-d33bb78f5762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Flow 'volume_create_manager' (ba61624c-c618-4595-b777-4faffbc30199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d7760d2b-9112-4fc9-af56-e9ca7e07cc6b tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created volume successfully. Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-3ecacc7e-15e8-47f1-8238-45668a5e1107-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-3ecacc7e-15e8-47f1-8238-45668a5e1107-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-quobyte-3ecacc7e-15e8-47f1-8238-45668a5e1107" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-3ecacc7e-15e8-47f1-8238-45668a5e1107" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f5b30a-2fc6-4e0a-9684-cc8d69931512]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:48 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec 1073741824" returned: 0 in 0.467s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:48 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 Sep 11 23:19:48 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:48 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec Sep 11 23:19:48 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:48 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:48 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.761s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1111960382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81abfacc-53c4-4db7-8730-e02befe775cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:44Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Creating volume 81abfacc-53c4-4db7-8730-e02befe775cb {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:48 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:49 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb 1073741824 Sep 11 23:19:49 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6ad649-3b58-4499-83e2-bba6c5c14211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:49 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107 Sep 11 23:19:49 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5929c4-6e0b-4dbc-9ec0-bbaef1a9e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec (aa6d3d80-e213-47c7-99e2-f6a206ac07ec): created successfully Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5929c4-6e0b-4dbc-9ec0-bbaef1a9e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (350fff16-644e-4582-af72-4c81b8556e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e9251e27-a3c7-4d71-8011-80188ca87bb3 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created volume successfully. Sep 11 23:19:49 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3ecacc7e-15e8-47f1-8238-45668a5e1107" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-3ecacc7e-15e8-47f1-8238-45668a5e1107" released by "delete_volume" :: held 0.714s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created reservations ['004e1c0f-defb-43a4-b947-5771a7ac6b71', '8e692b99-3712-465e-97b6-58ed1506558c', '590e7a50-df6b-46b6-93c5-ab60f9de8d73', 'a33c8832-7667-4c02-acdc-217146002147'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:49 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:49 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:49 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb 1073741824" returned: 0 in 0.463s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:49 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb Sep 11 23:19:49 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-c85ffcbe-7768-453f-a1d6-4cf61277bc77-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-c85ffcbe-7768-453f-a1d6-4cf61277bc77-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:49 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.315s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Deleted volume successfully. Sep 11 23:19:49 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.184s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379445775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad554e89-9881-40f6-9a62-adf6c24f1ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:44Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Creating volume ad554e89-9881-40f6-9a62-adf6c24f1ce1 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:49 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-quobyte-c85ffcbe-7768-453f-a1d6-4cf61277bc77" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:49 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 1073741824 Sep 11 23:19:49 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d871b08f-931d-48ee-9ee3-4f1e07a48f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81abfacc-53c4-4db7-8730-e02befe775cb', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82331803-6e14-4625-abf9-5bf5deb4bf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-459b3170-007a-4c8b-a875-131e86c8333f tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-3ecacc7e-15e8-47f1-8238-45668a5e1107-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-c85ffcbe-7768-453f-a1d6-4cf61277bc77" acquired by "delete_volume" :: waited 0.046s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume volume-81abfacc-53c4-4db7-8730-e02befe775cb (81abfacc-53c4-4db7-8730-e02befe775cb): created successfully Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82331803-6e14-4625-abf9-5bf5deb4bf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (de086bc5-d8fc-4f81-a129-231e2819e786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8a9473-f0be-4fae-a4b3-b8e0d59c7ea2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6a4e2bf9-cf3a-4552-8665-9518ad387b0c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created volume successfully. Sep 11 23:19:49 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 Sep 11 23:19:49 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:50 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 1073741824" returned: 0 in 0.465s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:50 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77" returned: 0 in 0.399s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:50 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77 Sep 11 23:19:50 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:50 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 Sep 11 23:19:50 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:50 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-c85ffcbe-7768-453f-a1d6-4cf61277bc77" returned: 0 in 0.238s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-c85ffcbe-7768-453f-a1d6-4cf61277bc77" released by "delete_volume" :: held 0.692s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:50 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1" returned: 0 in 0.256s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.609s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-437076726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb81e804-7154-4b57-9e7c-8b62035beea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:45Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Creating volume cb81e804-7154-4b57-9e7c-8b62035beea6 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:50 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:50 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 1073741824 Sep 11 23:19:50 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7115ac4b-5b53-4215-84ff-7198599c466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce978be7-96b5-4a1e-8e37-43cb0a29283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:50 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 (ad554e89-9881-40f6-9a62-adf6c24f1ce1): created successfully Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce978be7-96b5-4a1e-8e37-43cb0a29283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (98e724a2-10fe-40bd-af71-644881d7252a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-13f5d804-8a83-4dd0-a4a7-661d345c7778 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created volume successfully. Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created reservations ['cf62e6d8-9e0e-4814-ab31-816476bdf6fc', '9b3424c2-4122-4d3d-92aa-dc38d12d84e5', '2ba52a3d-97b3-4ebc-a4cb-2fb05bc38206', '83ec4706-d6a2-4aa9-9ecd-175686aad513'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:50 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:50 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-19e37a2f-ad9d-49b8-803e-f98cb2e79f88-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-19e37a2f-ad9d-49b8-803e-f98cb2e79f88-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-quobyte-19e37a2f-ad9d-49b8-803e-f98cb2e79f88" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-19e37a2f-ad9d-49b8-803e-f98cb2e79f88" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72e667f-59cf-4af6-b74b-828f5b2f044c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:51 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.300s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Deleted volume successfully. Sep 11 23:19:51 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28cf425c-063c-4480-bef7-647b5c4896c4 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-c85ffcbe-7768-453f-a1d6-4cf61277bc77-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 1073741824" returned: 0 in 0.561s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:51 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 Sep 11 23:19:51 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:51 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 Sep 11 23:19:51 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:51 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88" returned: 0 in 0.378s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:51 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:51 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88 Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6" returned: 0 in 0.258s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:51 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.057s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913481089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f302822-c3aa-4016-a073-6f2441d18b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00468ff6c884a2caf367466e00edb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:45Z,use_quota=True,user_id='e81a2e2415004ca19a825a1cfea888c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Creating volume 2f302822-c3aa-4016-a073-6f2441d18b46 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:51 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd614d2-2fa0-43d7-bcce-873a9464a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb81e804-7154-4b57-9e7c-8b62035beea6', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:51 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 1073741824 Sep 11 23:19:51 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d524e664-d4e3-446a-94bc-83b2da7283a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:51 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume volume-cb81e804-7154-4b57-9e7c-8b62035beea6 (cb81e804-7154-4b57-9e7c-8b62035beea6): created successfully Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d524e664-d4e3-446a-94bc-83b2da7283a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (0a8d3c0c-852f-4e7a-84f7-3652a8cc919d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-64a38252-dab7-475d-8d66-cba6b1588a59 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created volume successfully. Sep 11 23:19:51 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-19e37a2f-ad9d-49b8-803e-f98cb2e79f88" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-19e37a2f-ad9d-49b8-803e-f98cb2e79f88" released by "delete_volume" :: held 0.692s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created reservations ['ffcde040-dfba-483e-a7e6-da1eacf17d86', '11dbe8b6-7542-4da3-97c2-9e34fef88760', '2c539741-f014-465c-ae81-3afa1b04733e', 'dc3964e9-8e1c-446c-8fff-b8eaddbc5ef8'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:51 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:51 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:51 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 1073741824" returned: 0 in 0.500s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:51 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 Sep 11 23:19:51 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:52 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.287s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-quobyte-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Deleted volume successfully. Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-78ab0399-8acc-458d-93a8-db96c0c666af tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-19e37a2f-ad9d-49b8-803e-f98cb2e79f88-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b98b0f1-8e8c-40a8-8c52-dc38875be556]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:52 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46" returned: 0 in 0.294s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.257s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:19:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1616676980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da331884-6382-4bc0-800c-0333889fa8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba6fd72d8744860a062b22173bfbe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:19:46Z,use_quota=True,user_id='2e221184d9a54bb5a22811b9b78f5c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Creating volume da331884-6382-4bc0-800c-0333889fa8c2 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:19:52 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45a3a9d-b883-4cba-9a43-9bb6ab95d655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f302822-c3aa-4016-a073-6f2441d18b46', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:52 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac Sep 11 23:19:52 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d22099a-cf36-4aea-9f2e-cb68a627bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:52 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 1073741824 Sep 11 23:19:52 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:52 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Volume volume-2f302822-c3aa-4016-a073-6f2441d18b46 (2f302822-c3aa-4016-a073-6f2441d18b46): created successfully Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d22099a-cf36-4aea-9f2e-cb68a627bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Flow 'volume_create_manager' (bd91e45c-2b53-4331-a63b-eb93dbfc2b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8424ad22-feca-4154-95ae-e67110b7209e tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created volume successfully. Sep 11 23:19:52 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac" returned: 0 in 0.365s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:52 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac Sep 11 23:19:52 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:52 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 1073741824" returned: 0 in 0.456s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:52 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 Sep 11 23:19:52 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:52 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac" released by "delete_volume" :: held 0.691s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created reservations ['26bf54d5-d5e0-4c3e-9db0-0e43aa48e552', 'ff8d19b4-de9e-4228-83d9-8ad98a88ac3d', '232aeab3-7896-4348-9934-203b42420a7f', '0f43a61f-a0a0-440d-bc91-f3fe639ac650'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:52 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:52 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-2f302822-c3aa-4016-a073-6f2441d18b46-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-2f302822-c3aa-4016-a073-6f2441d18b46-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-quobyte-2f302822-c3aa-4016-a073-6f2441d18b46" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:53 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2" returned: 0 in 0.339s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.264s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-2f302822-c3aa-4016-a073-6f2441d18b46" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30086a0c-6a99-493b-8323-b6ecec886b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da331884-6382-4bc0-800c-0333889fa8c2', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bca549-fb54-4d83-8c7c-9fee14ee9aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6082af8c-9442-4a9b-99c0-2e6f10bf48e9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot 3d8bc42b-ce8c-404e-874d-16a79c6edf0f of volume 603b36c9-1a8d-4c7c-b443-fcb2e987348d {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:53 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Volume volume-da331884-6382-4bc0-800c-0333889fa8c2 (da331884-6382-4bc0-800c-0333889fa8c2): created successfully Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bca549-fb54-4d83-8c7c-9fee14ee9aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Flow 'volume_create_manager' (8c5517db-1e05-4266-93a0-4c128009478c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f67baa5-893a-42b9-8aa1-4bf3e80156af]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-9cb1c009-206f-47d0-a93f-5b088e48cc50-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3fbc43e5-a2dd-4d84-b719-677bae99f38d tempest-CinderUnicodeTest-2127228511 None] Created volume successfully. Sep 11 23:19:53 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.359s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 Sep 11 23:19:53 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-9cb1c009-206f-47d0-a93f-5b088e48cc50-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Deleted volume successfully. Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b5d6261f-0ef0-4100-bd0d-95a6998ee2e5 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-e80cf8d3-8ba6-4994-98ad-2ecb169dc4ac-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-quobyte-9cb1c009-206f-47d0-a93f-5b088e48cc50" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-9cb1c009-206f-47d0-a93f-5b088e48cc50" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[402f1b22-4334-4593-b32f-6fc4e0db323f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d Sep 11 23:19:53 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 Sep 11 23:19:53 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46" returned: 0 in 0.476s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46 Sep 11 23:19:53 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:53 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d" returned: 0 in 0.539s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f 1G Sep 11 23:19:53 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50" returned: 0 in 0.467s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:53 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50 Sep 11 23:19:53 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:53 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2f302822-c3aa-4016-a073-6f2441d18b46" returned: 0 in 0.313s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-2f302822-c3aa-4016-a073-6f2441d18b46" released by "delete_volume" :: held 0.848s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created reservations ['cbfcb9a5-923b-49f9-8dee-ef5009ee1459', 'e298db90-7b73-4949-956e-81ec1ba863ba', '59db08fb-91b0-4f9e-a206-f6bc9b693b08', '71a45257-101a-49f2-84c5-51efed52d7ac'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:54 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:54 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-9cb1c009-206f-47d0-a93f-5b088e48cc50" returned: 0 in 0.298s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-9cb1c009-206f-47d0-a93f-5b088e48cc50" released by "delete_volume" :: held 0.830s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-cb81e804-7154-4b57-9e7c-8b62035beea6-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:54 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f 1G" returned: 0 in 0.476s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-cb81e804-7154-4b57-9e7c-8b62035beea6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:54 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created reservations ['00b93944-e312-4c9c-9049-dc54467efa1c', 'f1483ce3-57be-4885-85bd-bb86a4dd74e4', '046f8366-daf6-4b76-87f5-f5a7086c5196', 'd0fe5c9c-1b4c-488b-a6b3-032b8dd8069b'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-quobyte-cb81e804-7154-4b57-9e7c-8b62035beea6" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-cb81e804-7154-4b57-9e7c-8b62035beea6" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebb8558-3006-447a-a73b-0efba7d510f9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.355s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:54 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Deleted volume successfully. Sep 11 23:19:54 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:54 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-60afa064-83af-4016-9e28-5ded1faad7a7 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-2f302822-c3aa-4016-a073-6f2441d18b46-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:54 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 Sep 11 23:19:54 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:54 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f" returned: 0 in 0.396s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f is being set with open permissions: ugo+rw Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f Sep 11 23:19:54 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:54 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.314s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:54 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Deleted volume successfully. Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-b0c53e6e-b106-4667-9667-18a81cf790f0 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-9cb1c009-206f-47d0-a93f-5b088e48cc50-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:54 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6" returned: 0 in 0.435s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6 Sep 11 23:19:54 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:54 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:54 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.info Sep 11 23:19:54 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:55 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cb81e804-7154-4b57-9e7c-8b62035beea6" returned: 0 in 0.244s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-cb81e804-7154-4b57-9e7c-8b62035beea6" released by "delete_volume" :: held 0.737s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created reservations ['03f99b63-c750-457e-ad17-af5889e69ceb', 'fd97db12-8f39-4c87-8853-34b8a363dbf8', '7244eeab-6159-4497-845e-7b62454b1cff', '714076e4-300c-4b52-b371-493acc4c824d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:55 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:55 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:55 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.info" returned: 0 in 0.292s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:55 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.info is being set with open permissions: ugo+rw Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:55 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.info Sep 11 23:19:55 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-ad554e89-9881-40f6-9a62-adf6c24f1ce1-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-ad554e89-9881-40f6-9a62-adf6c24f1ce1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:55 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Deleted volume successfully. Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-quobyte-ad554e89-9881-40f6-9a62-adf6c24f1ce1" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a7d0d204-179d-4453-ad7a-dd29bcfe599a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-cb81e804-7154-4b57-9e7c-8b62035beea6-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-ad554e89-9881-40f6-9a62-adf6c24f1ce1" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-cff98cb3-138c-435f-903e-a4e013fa262b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc97adbd-6a2a-432c-99b3-f8386f20db65]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:55 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.info" returned: 0 in 0.369s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-cff98cb3-138c-435f-903e-a4e013fa262b-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.934s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Creating offline snapshot 3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 of volume da331884-6382-4bc0-800c-0333889fa8c2 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bddeae6-f124-4496-9b83-c01716dda3ec]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8ededed5-63b4-4a54-86b3-de00b2659610 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:19:55 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 Sep 11 23:19:55 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "cinder-quobyte-cff98cb3-138c-435f-903e-a4e013fa262b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-cff98cb3-138c-435f-903e-a4e013fa262b" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[994ef8d2-38d7-45c9-b65a-199053ec7a39]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:55 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 Sep 11 23:19:55 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:55 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b Sep 11 23:19:55 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:56 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1 Sep 11 23:19:56 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:56 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2" returned: 0 in 0.403s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 1G Sep 11 23:19:56 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-3d8bc42b-ce8c-404e-874d-16a79c6edf0f-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:56 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b" returned: 0 in 0.438s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Lock "cinder-3d8bc42b-ce8c-404e-874d-16a79c6edf0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-603b36c9-1a8d-4c7c-b443-fcb2e987348d" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:56 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b Sep 11 23:19:56 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-603b36c9-1a8d-4c7c-b443-fcb2e987348d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-3d8bc42b-ce8c-404e-874d-16a79c6edf0f" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-3d8bc42b-ce8c-404e-874d-16a79c6edf0f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot 3d8bc42b-ce8c-404e-874d-16a79c6edf0f of volume 603b36c9-1a8d-4c7c-b443-fcb2e987348d {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:56 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ad554e89-9881-40f6-9a62-adf6c24f1ce1" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[747a3fca-2428-4535-bafc-e58acf9b4b5c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-ad554e89-9881-40f6-9a62-adf6c24f1ce1" released by "delete_volume" :: held 0.823s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created reservations ['71fe2b1d-8e71-4f0a-931a-981564f9b552', '6ab74d97-4af2-4534-ae37-0d157631a3d6', '7c82b3e8-8a85-42a7-b907-7bc214e879b0', '94ae5c6c-ce4d-4d9f-9fc7-74ce93c5422a'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:56 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f Sep 11 23:19:56 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-cff98cb3-138c-435f-903e-a4e013fa262b" returned: 0 in 0.304s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:56 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:56 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-quobyte-cff98cb3-138c-435f-903e-a4e013fa262b" released by "delete_volume" :: held 0.809s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-81abfacc-53c4-4db7-8730-e02befe775cb-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-81abfacc-53c4-4db7-8730-e02befe775cb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Created reservations ['18eba956-4d2e-4a6e-aad7-ab8c8bf25f4e', '280ae281-a974-4e89-a890-5fc402d37810', '63f8cd50-65b1-46c2-8b22-2f74d3ded4d8', '804452a1-4fd2-4bc0-bc59-5a6c39d0f3ad'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:56 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-quobyte-81abfacc-53c4-4db7-8730-e02befe775cb" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 1G" returned: 0 in 0.664s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da331884-6382-4bc0-800c-0333889fa8c2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da331884-6382-4bc0-800c-0333889fa8c2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 Sep 11 23:19:56 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-81abfacc-53c4-4db7-8730-e02befe775cb" acquired by "delete_volume" :: waited 0.047s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:56 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.329s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f6c6b2-915f-4930-888b-c34d1c625793]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Deleted volume successfully. Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38cfe87c-1470-4145-ad8a-2352f2f77043 tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-ad554e89-9881-40f6-9a62-adf6c24f1ce1-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:56 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:56 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f" returned: 0 in 0.653s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:57 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb Sep 11 23:19:57 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f213f43-5cf9-43a6-98ef-968845ddcb22]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:57 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da331884-6382-4bc0-800c-0333889fa8c2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37" returned: 0 in 0.375s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 is being set with open permissions: ugo+rw Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:57 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d Sep 11 23:19:57 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 Sep 11 23:19:57 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.324s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:57 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Deleted volume successfully. Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-a25795c3-29d5-4475-a2ac-2906237c8fe7 tempest-CreateVolumesFromSourceVolumeTest-1486811232 None] Lock "cinder-cff98cb3-138c-435f-903e-a4e013fa262b-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:57 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb" returned: 0 in 0.489s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:57 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb Sep 11 23:19:57 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37" returned: 0 in 0.250s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:57 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.info Sep 11 23:19:57 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d" returned: 0 in 0.464s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:57 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f Sep 11 23:19:57 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81abfacc-53c4-4db7-8730-e02befe775cb" returned: 0 in 0.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-81abfacc-53c4-4db7-8730-e02befe775cb" released by "delete_volume" :: held 0.831s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created reservations ['da0506d9-bdc0-491c-8b66-34f4cb01b88b', '81b88051-1fbf-401d-93d3-cb983a207376', '96a38c09-4ad5-4e2e-956c-ed4ff096b380', 'a9b2c711-c5c3-44d9-8656-7313f1ee121e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:57 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.info" returned: 0 in 0.299s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:57 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.info is being set with open permissions: ugo+rw Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:57 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.info Sep 11 23:19:57 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:57 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:57 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-aa6d3d80-e213-47c7-99e2-f6a206ac07ec-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-aa6d3d80-e213-47c7-99e2-f6a206ac07ec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:58 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f" returned: 0 in 0.509s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-quobyte-aa6d3d80-e213-47c7-99e2-f6a206ac07ec" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:58 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f Sep 11 23:19:58 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-aa6d3d80-e213-47c7-99e2-f6a206ac07ec" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3209c9d0-0a99-43b8-83c0-688ce4468029]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:58 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.345s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Deleted volume successfully. Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6daab15b-55a1-4d91-9774-047c6201bf8c tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-81abfacc-53c4-4db7-8730-e02befe775cb-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:58 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.info" returned: 0 in 0.458s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:58 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec Sep 11 23:19:58 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c04c602f-c13a-4c0c-8d7b-71d9bed54b6a tempest-CinderUnicodeTest-2127228511 None] Create snapshot completed successfully Sep 11 23:19:58 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d.3d8bc42b-ce8c-404e-874d-16a79c6edf0f" returned: 0 in 0.342s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-3d8bc42b-ce8c-404e-874d-16a79c6edf0f" released by "_delete_snapshot" :: held 2.087s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-603b36c9-1a8d-4c7c-b443-fcb2e987348d" released by "delete_snapshot" :: held 2.115s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Created reservations ['18a5f11c-2aa4-4b71-a137-7a61cf935508', 'f343f371-aa77-4619-b04f-d6dc06f6d3d2', '1b155985-05eb-4334-8f13-45ec63477d67', '3b2de5a2-3043-43df-a3ad-267ce8097e7a'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:58 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-49383225-3bbc-4a4a-91f8-aab2f6b2415a tempest-ProjectMemberTests-1931110376 None] Lock "cinder-3d8bc42b-ce8c-404e-874d-16a79c6edf0f-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:58 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec" returned: 0 in 0.452s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:58 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec Sep 11 23:19:58 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:58 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-aa6d3d80-e213-47c7-99e2-f6a206ac07ec" returned: 0 in 0.260s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-aa6d3d80-e213-47c7-99e2-f6a206ac07ec" released by "delete_volume" :: held 0.771s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:58 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created reservations ['f14c465f-66d3-4bda-91ea-0e68370ea2c5', '60b00edc-23e1-4597-8b76-61e3d65cd944', '12d80eda-3c2a-45b8-a12b-1df9616b1eab', '23b5785a-988d-4962-842e-7c3e266f3798'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:19:59 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "cinder-3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "cinder-quobyte-da331884-6382-4bc0-800c-0333889fa8c2" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-quobyte-da331884-6382-4bc0-800c-0333889fa8c2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "cinder-quobyte-3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-quobyte-3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Deleting offline snapshot 3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 of volume da331884-6382-4bc0-800c-0333889fa8c2 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] snapshot_file for this snap is: volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-a7d67778-eb32-45dc-9c7b-43e01f5ae6a3-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cd7824-a166-48db-b59a-8cc4d4e57cf8]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-a7d67778-eb32-45dc-9c7b-43e01f5ae6a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-quobyte-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-quobyte-a7d67778-eb32-45dc-9c7b-43e01f5ae6a3" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-a7d67778-eb32-45dc-9c7b-43e01f5ae6a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Deleting offline snapshot a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 of volume 2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] snapshot_file for this snap is: volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[72457893-03fa-433b-86ea-4b84c22b58b2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.354s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:19:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Deleted volume successfully. Sep 11 23:19:59 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 Sep 11 23:19:59 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-08f62e32-8ea8-453a-89bf-49553136a24a tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-aa6d3d80-e213-47c7-99e2-f6a206ac07ec-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-603b36c9-1a8d-4c7c-b443-fcb2e987348d-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-603b36c9-1a8d-4c7c-b443-fcb2e987348d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:59 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 Sep 11 23:19:59 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-603b36c9-1a8d-4c7c-b443-fcb2e987348d" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-603b36c9-1a8d-4c7c-b443-fcb2e987348d" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[578b3797-1727-4367-aaaf-2d4568ebda51]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37" returned: 0 in 0.518s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da331884-6382-4bc0-800c-0333889fa8c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f74383f-4eb4-4834-8c9a-e3d5b76f5f89]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:19:59 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d Sep 11 23:19:59 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:59 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3" returned: 0 in 0.600s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:19:59 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 Sep 11 23:19:59 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd1f5b5-f4ff-4a17-bdf2-895308939b96]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:19:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 Sep 11 23:20:00 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d Sep 11 23:20:00 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 Sep 11 23:20:00 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" returned: 0 in 0.455s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-603b36c9-1a8d-4c7c-b443-fcb2e987348d" returned: 0 in 0.323s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 Sep 11 23:20:00 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-603b36c9-1a8d-4c7c-b443-fcb2e987348d" released by "delete_volume" :: held 0.852s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Created reservations ['7f8bf8cf-ddbe-4289-b68a-6e3f97716252', '7950e6f2-8582-4295-ade7-12ff1e2534fb', '908314d2-3473-47c8-b421-050628f56ac7', 'c698b7a2-9fe6-4095-bedb-828257ff3955'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:00 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37" returned: 0 in 0.577s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37 Sep 11 23:20:00 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:00 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3" returned: 0 in 0.472s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:00 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3 Sep 11 23:20:00 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:01 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.468s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-227ddf00-febb-4d68-971c-341557838984 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-603b36c9-1a8d-4c7c-b443-fcb2e987348d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:01 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5.a7d67778-eb32-45dc-9c7b-43e01f5ae6a3" returned: 0 in 0.351s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:01 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2.3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37" returned: 0 in 0.459s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-a7d67778-eb32-45dc-9c7b-43e01f5ae6a3" released by "_delete_snapshot" :: held 2.025s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" released by "delete_snapshot" :: held 2.074s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-quobyte-3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37" released by "_delete_snapshot" :: held 2.188s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-quobyte-da331884-6382-4bc0-800c-0333889fa8c2" released by "delete_snapshot" :: held 2.221s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (022024cd-13e1-409c-8282-fc846d4734f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f731256-9fd6-4f97-be1a-b0f6306e232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f731256-9fd6-4f97-be1a-b0f6306e232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1740723280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97811834-cdec-4fc5-b1fd-8e9992b14af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:01Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1aa837-b888-4ba7-ad16-120d5e3c2e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1aa837-b888-4ba7-ad16-120d5e3c2e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6770cb0f-bf60-40bd-b741-bb972c3940a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6770cb0f-bf60-40bd-b741-bb972c3940a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97811834-cdec-4fc5-b1fd-8e9992b14af1', 'volume_name': 'volume-97811834-cdec-4fc5-b1fd-8e9992b14af1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bebb0e-dff6-44ab-800b-886650209904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bebb0e-dff6-44ab-800b-886650209904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f2302e-f1e7-4102-b7e0-495a187c7f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:01 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Volume 97811834-cdec-4fc5-b1fd-8e9992b14af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97811834-cdec-4fc5-b1fd-8e9992b14af1', 'volume_size': 1} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1740723280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97811834-cdec-4fc5-b1fd-8e9992b14af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:01Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Creating volume 97811834-cdec-4fc5-b1fd-8e9992b14af1 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:01 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:01 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 1073741824 Sep 11 23:20:01 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created reservations ['838840e9-11de-41cb-988b-9d4e674be40b', '6f5c6252-fe7d-4357-ac98-835d6173afca', 'a1f31cd1-02b3-4992-a373-99700f417295', 'bc512623-a83b-497f-8a6d-cb3c40d15b02'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Created reservations ['77f44dc2-d46e-4d54-91a6-aa10bc93d82d', '3f852ab8-f4b1-41cd-9b2a-3df6f346104d', '2eaa7b4a-8d84-4902-b06c-483f62bf1620', '55894bee-77b7-49b0-a835-c92f2043627e'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Delete snapshot completed successfully. Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-57dbbd8a-03b8-4a03-96f3-e91c0b5a281d tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-a7d67778-eb32-45dc-9c7b-43e01f5ae6a3-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Delete snapshot completed successfully. Sep 11 23:20:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-06a7b066-c4e5-4692-8cb9-a93c407da842 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-3e8b2b44-1ca1-4c85-8fc7-bb16d5bbca37-delete_snapshot" released by "delete_snapshot" :: held 2.645s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:02 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 1073741824" returned: 0 in 0.461s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:02 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 Sep 11 23:20:02 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-74204d1d-9a6c-4d30-93ca-2cc278ffe467 tempest-ProjectAdminTests-2133565416 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88026) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 11 23:20:02 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1" returned: 0 in 0.286s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "cinder-da331884-6382-4bc0-800c-0333889fa8c2-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f2302e-f1e7-4102-b7e0-495a187c7f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97811834-cdec-4fc5-b1fd-8e9992b14af1', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314e5e2d-9e91-429d-a993-c84feef76557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:02 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Volume volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 (97811834-cdec-4fc5-b1fd-8e9992b14af1): created successfully Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314e5e2d-9e91-429d-a993-c84feef76557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (022024cd-13e1-409c-8282-fc846d4734f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-da331884-6382-4bc0-800c-0333889fa8c2-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7cb6304e-139e-45b8-aa8f-648e31622ec6 tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "cinder-quobyte-da331884-6382-4bc0-800c-0333889fa8c2" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-quobyte-da331884-6382-4bc0-800c-0333889fa8c2" acquired by "delete_volume" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2903d43-4771-4a89-a00f-88fe4fb9f324]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "cinder-quobyte-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6457e849-1c24-4243-959c-09f2d58f57ba]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:02 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 Sep 11 23:20:02 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:02 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 Sep 11 23:20:02 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:03 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2" returned: 0 in 0.419s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:03 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2 Sep 11 23:20:03 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:03 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" returned: 0 in 0.454s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:03 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5 Sep 11 23:20:03 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:03 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-da331884-6382-4bc0-800c-0333889fa8c2" returned: 0 in 0.291s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-quobyte-da331884-6382-4bc0-800c-0333889fa8c2" released by "delete_volume" :: held 0.810s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Created reservations ['611db3b6-2b88-4719-b6f6-0c9457034b3c', '7abcc2da-9d77-42af-9f01-6f5d562b9921', '5657aa02-76ae-4e55-b760-2d3e773dfb57', 'c2d26881-0186-4293-954b-fb69e1505520'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:03 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" returned: 0 in 0.334s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-quobyte-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5" released by "delete_volume" :: held 0.903s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "cinder-e03e0ace-0a94-4849-a2d1-0133f6822b12-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:03 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:03 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-e03e0ace-0a94-4849-a2d1-0133f6822b12-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Created reservations ['c2f9158f-a2c8-4693-93d1-9b63442dfa77', 'c1329c7f-1ca7-476f-a33c-f3bea9ba3a88', '09db6912-44ce-4a61-83ae-f7e24122701a', 'bd583a1b-beb0-4ba5-a188-691a74d11de4'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "cinder-quobyte-e03e0ace-0a94-4849-a2d1-0133f6822b12" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot 8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 of volume 97811834-cdec-4fc5-b1fd-8e9992b14af1 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-quobyte-e03e0ace-0a94-4849-a2d1-0133f6822b12" acquired by "delete_volume" :: waited 0.036s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[381eeb62-673d-4087-a3f2-3d0a8f8447e3]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d760c239-cfdd-4063-8981-6855833d358a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:04 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:04 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:04 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:04 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 Sep 11 23:20:04 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.455s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Deleted volume successfully. Sep 11 23:20:04 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 Sep 11 23:20:04 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-dd23cb7d-c77e-4600-90cf-1b7ea930d6d4 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-da331884-6382-4bc0-800c-0333889fa8c2-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:04 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.386s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Deleted volume successfully. Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-51958795-264e-452f-bdf6-185b9ebd688f tempest-CreateVolumesFromSnapshotTest-1492300925 None] Lock "cinder-2d8735ab-d122-4d6c-8079-e2b8e4a7fec5-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:04 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12" returned: 0 in 0.537s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:04 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12 Sep 11 23:20:04 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:04 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1" returned: 0 in 0.605s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:04 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 1G Sep 11 23:20:04 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:04 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e03e0ace-0a94-4849-a2d1-0133f6822b12" returned: 0 in 0.289s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-quobyte-e03e0ace-0a94-4849-a2d1-0133f6822b12" released by "delete_volume" :: held 0.882s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Created reservations ['55e0b87b-3e81-415f-a810-345e6f847df6', 'bcea5048-755f-4d94-b6b2-4ee6b2292747', 'ddf89b56-c814-4ae1-a8eb-82fa177eecc7', '65e7492e-d2df-4102-8157-a67ad6215508'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:04 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:04 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:05 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 1G" returned: 0 in 0.596s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:05 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 Sep 11 23:20:05 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:05 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.327s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:05 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Deleted volume successfully. Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c5e225c4-f62c-49b1-a2f1-6aa827685498 tempest-CinderUnicodeTest-2127228511 None] Lock "cinder-e03e0ace-0a94-4849-a2d1-0133f6822b12-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:05 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714" returned: 0 in 0.373s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:05 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 is being set with open permissions: ugo+rw Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:05 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 Sep 11 23:20:05 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:05 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714" returned: 0 in 0.322s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:05 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.info Sep 11 23:20:05 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:06 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.info" returned: 0 in 0.341s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:06 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.info is being set with open permissions: ugo+rw Sep 11 23:20:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:06 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.info Sep 11 23:20:06 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:06 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.info" returned: 0 in 0.300s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-68c7d31f-f49a-409f-a12b-a8baea3e4825 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-8ebbbb76-d7c6-4cb3-824a-e0e67c41a714-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-8ebbbb76-d7c6-4cb3-824a-e0e67c41a714-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-97811834-cdec-4fc5-b1fd-8e9992b14af1" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-97811834-cdec-4fc5-b1fd-8e9992b14af1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-8ebbbb76-d7c6-4cb3-824a-e0e67c41a714" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8ebbbb76-d7c6-4cb3-824a-e0e67c41a714" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot 8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 of volume 97811834-cdec-4fc5-b1fd-8e9992b14af1 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e8333e-fdce-421e-b080-98b4f82f4530]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:07 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 Sep 11 23:20:07 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:07 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714" returned: 0 in 0.529s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97811834-cdec-4fc5-b1fd-8e9992b14af1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4994f15f-2ae1-450f-9a37-9fe2872c9509]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (d446feeb-2f7f-4e1d-946f-27e73336c836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a452aa21-f3ab-4dc3-a979-f15a8c9a00ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a452aa21-f3ab-4dc3-a979-f15a8c9a00ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117655676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f55a9fd-932a-4207-a580-bf22b347d3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:08Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e991185-7c49-47c8-b588-3b76baf9e850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e991185-7c49-47c8-b588-3b76baf9e850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:07 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 Sep 11 23:20:07 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a211df34-a078-4d41-a4c9-32baea6dacf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a211df34-a078-4d41-a4c9-32baea6dacf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f55a9fd-932a-4207-a580-bf22b347d3c2', 'volume_name': 'volume-3f55a9fd-932a-4207-a580-bf22b347d3c2', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdc0f04-6cf8-45a8-9c87-73a960ee5a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdc0f04-6cf8-45a8-9c87-73a960ee5a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d532b-ae08-4a52-b8d6-c83cf79aaf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:07 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Volume 3f55a9fd-932a-4207-a580-bf22b347d3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f55a9fd-932a-4207-a580-bf22b347d3c2', 'volume_size': 1} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117655676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f55a9fd-932a-4207-a580-bf22b347d3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:08Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Creating volume 3f55a9fd-932a-4207-a580-bf22b347d3c2 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:07 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:07 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 1073741824 Sep 11 23:20:07 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:08 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1" returned: 0 in 0.475s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:08 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 Sep 11 23:20:08 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:08 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 1073741824" returned: 0 in 0.530s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:08 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 Sep 11 23:20:08 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:08 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714" returned: 0 in 0.501s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:08 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714 Sep 11 23:20:08 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:08 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2" returned: 0 in 0.329s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3d532b-ae08-4a52-b8d6-c83cf79aaf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f55a9fd-932a-4207-a580-bf22b347d3c2', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6b8c92-d965-4d2f-8ab8-33dd7d08bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:08 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Volume volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 (3f55a9fd-932a-4207-a580-bf22b347d3c2): created successfully Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6b8c92-d965-4d2f-8ab8-33dd7d08bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:08 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (d446feeb-2f7f-4e1d-946f-27e73336c836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:08 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-78d0cc9b-2185-4e3b-af12-4a2863fb2b3d tempest-ProjectReaderTests-270232278 None] Created volume successfully. Sep 11 23:20:09 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1.8ebbbb76-d7c6-4cb3-824a-e0e67c41a714" returned: 0 in 0.294s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8ebbbb76-d7c6-4cb3-824a-e0e67c41a714" released by "_delete_snapshot" :: held 1.968s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-97811834-cdec-4fc5-b1fd-8e9992b14af1" released by "delete_snapshot" :: held 1.998s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:09 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Created reservations ['4956b1e5-c1cc-41b0-ad38-c7cb34d3a2c3', '914517a5-293e-447d-b5c0-002893824731', 'de29d9d7-8d49-4d50-a8e7-5a5ad87617d7', '48f02b29-104a-4065-b3bb-f6a49a4411ec'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:20:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d3723efb-0019-480a-bd64-f7f48cb6e137 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-8ebbbb76-d7c6-4cb3-824a-e0e67c41a714-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Creating offline snapshot 6c0f2552-b619-4dbf-a6b5-8ef882d495ba of volume 3f55a9fd-932a-4207-a580-bf22b347d3c2 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e848f9-a17d-4a08-8106-94f57386dcb2]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:10 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 Sep 11 23:20:10 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-97811834-cdec-4fc5-b1fd-8e9992b14af1-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Lock "cinder-97811834-cdec-4fc5-b1fd-8e9992b14af1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=223,cinder:UPDATE=310,cinder:INSERT=84,cinder:DELETE=24 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=309,cinder:SELECT=239,cinder:INSERT=82,cinder:DELETE=31 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-97811834-cdec-4fc5-b1fd-8e9992b14af1" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-97811834-cdec-4fc5-b1fd-8e9992b14af1" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:10 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2" returned: 0 in 0.456s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca36ff-e15d-4713-b12d-592f5923407a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:10 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba 1G Sep 11 23:20:10 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:10 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 Sep 11 23:20:10 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:10 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1" returned: 0 in 0.469s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:11 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1 Sep 11 23:20:11 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:11 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba 1G" returned: 0 in 0.530s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:11 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba Sep 11 23:20:11 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:11 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-97811834-cdec-4fc5-b1fd-8e9992b14af1" returned: 0 in 0.330s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-97811834-cdec-4fc5-b1fd-8e9992b14af1" released by "delete_volume" :: held 0.885s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Created reservations ['90b10468-d8f8-41ee-8702-c201c5d092ab', '29cef8b3-d096-4d22-8468-a67ba2429fd8', '6d3105e3-ad11-43ad-8c70-ffb2bc23568d', '106dfd0b-212a-4ef1-8e13-39e8e33cc901'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:11 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba" returned: 0 in 0.427s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:11 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba is being set with open permissions: ugo+rw Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:11 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:11 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:11 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba Sep 11 23:20:11 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:11 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:11 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:11 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.372s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:20:11 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba" returned: 0 in 0.416s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:11 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.info Sep 11 23:20:11 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:12 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.402s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:12 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:12 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:20:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d8688e87-9b8b-4412-b5cb-0460858c401b tempest-ProjectMemberTests-1931110376 None] Lock "cinder-97811834-cdec-4fc5-b1fd-8e9992b14af1-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:12 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.info" returned: 0 in 0.315s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:12 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.info is being set with open permissions: ugo+rw Sep 11 23:20:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:12 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.info Sep 11 23:20:12 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:12 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.info" returned: 0 in 0.252s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:12 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5ed230d2-ea0f-4c96-ab27-6e9fd8bfa218 tempest-ProjectReaderTests-270232278 None] Create snapshot completed successfully Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (12b5c46a-38ac-4d7f-aaa8-a2d750e52b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7049a02-162c-4b2b-b358-5284caf5c53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7049a02-162c-4b2b-b358-5284caf5c53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334613753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f38ab1-2eb9-4697-816b-f4e4fc85daf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:13Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f10d55-9f40-4726-98db-dafa8dd2a5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f10d55-9f40-4726-98db-dafa8dd2a5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc701ac-3cd5-4768-959d-19b688c27240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc701ac-3cd5-4768-959d-19b688c27240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f38ab1-2eb9-4697-816b-f4e4fc85daf3', 'volume_name': 'volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255ecd59-9084-4c94-a21a-d8c56a63080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255ecd59-9084-4c94-a21a-d8c56a63080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6086066d-45d1-479e-8a25-f195c7769a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:13 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Volume 41f38ab1-2eb9-4697-816b-f4e4fc85daf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3', 'volume_size': 1} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334613753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f38ab1-2eb9-4697-816b-f4e4fc85daf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:13Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Creating volume 41f38ab1-2eb9-4697-816b-f4e4fc85daf3 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:13 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:13 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 1073741824 Sep 11 23:20:13 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-6c0f2552-b619-4dbf-a6b5-8ef882d495ba-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Lock "cinder-6c0f2552-b619-4dbf-a6b5-8ef882d495ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-3f55a9fd-932a-4207-a580-bf22b347d3c2" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-3f55a9fd-932a-4207-a580-bf22b347d3c2" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-6c0f2552-b619-4dbf-a6b5-8ef882d495ba" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-6c0f2552-b619-4dbf-a6b5-8ef882d495ba" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Deleting offline snapshot 6c0f2552-b619-4dbf-a6b5-8ef882d495ba of volume 3f55a9fd-932a-4207-a580-bf22b347d3c2 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] snapshot_file for this snap is: volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5447ca17-2ac4-4954-832b-0a560aa186cf]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:13 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba Sep 11 23:20:13 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:14 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 1073741824" returned: 0 in 0.646s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:14 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 Sep 11 23:20:14 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:14 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba" returned: 0 in 0.514s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f55a9fd-932a-4207-a580-bf22b347d3c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64797c-cd0f-42a2-af02-fdfa6f61cbdd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:14 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" returned: 0 in 0.326s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6086066d-45d1-479e-8a25-f195c7769a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ea3592-c63d-4466-86a0-a0aed87126f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:14 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 Sep 11 23:20:14 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:14 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Volume volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 (41f38ab1-2eb9-4697-816b-f4e4fc85daf3): created successfully Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ea3592-c63d-4466-86a0-a0aed87126f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (12b5c46a-38ac-4d7f-aaa8-a2d750e52b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cb18a68d-6faa-4abb-a49f-b77e4fa31c8b tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:20:14 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2" returned: 0 in 0.564s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:14 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba Sep 11 23:20:14 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:15 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba" returned: 0 in 0.516s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:15 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba Sep 11 23:20:15 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot e18c186b-8fd1-4e47-9f50-3dab234e352c of volume 41f38ab1-2eb9-4697-816b-f4e4fc85daf3 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4821bafe-7179-4b37-8e8f-e533d096e1fa]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:15 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2.6c0f2552-b619-4dbf-a6b5-8ef882d495ba" returned: 0 in 0.455s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-6c0f2552-b619-4dbf-a6b5-8ef882d495ba" released by "_delete_snapshot" :: held 2.185s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-3f55a9fd-932a-4207-a580-bf22b347d3c2" released by "delete_snapshot" :: held 2.236s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:15 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 Sep 11 23:20:15 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:15 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Created reservations ['fcd3117a-3fcf-4e69-8671-971dbfd8faf7', '19364441-9de9-4eaf-be6e-5c7f292afe20', '3bb93fce-e640-4df2-a2ac-c91f2cb58331', '6c506189-0338-4ef4-925d-92c34fc2e662'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Delete snapshot completed successfully. Sep 11 23:20:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-747c4f9c-0544-4d55-bc95-21fd531b049e tempest-ProjectReaderTests-270232278 None] Lock "cinder-6c0f2552-b619-4dbf-a6b5-8ef882d495ba-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:16 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" returned: 0 in 0.486s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:16 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c 1G Sep 11 23:20:16 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:16 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c 1G" returned: 0 in 0.459s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:16 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c Sep 11 23:20:16 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-3f55a9fd-932a-4207-a580-bf22b347d3c2-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Lock "cinder-3f55a9fd-932a-4207-a580-bf22b347d3c2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:16 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-3f55a9fd-932a-4207-a580-bf22b347d3c2" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-3f55a9fd-932a-4207-a580-bf22b347d3c2" acquired by "delete_volume" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:17 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c" returned: 0 in 0.353s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c is being set with open permissions: ugo+rw Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb20c6ba-f42f-497d-af36-1d13e62a363b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c Sep 11 23:20:17 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 Sep 11 23:20:17 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c" returned: 0 in 0.319s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.info Sep 11 23:20:17 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2" returned: 0 in 0.419s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2 Sep 11 23:20:17 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.info" returned: 0 in 0.327s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.info is being set with open permissions: ugo+rw Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:17 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.info Sep 11 23:20:17 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:17 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3f55a9fd-932a-4207-a580-bf22b347d3c2" returned: 0 in 0.321s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-3f55a9fd-932a-4207-a580-bf22b347d3c2" released by "delete_volume" :: held 0.842s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:17 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Created reservations ['cc3103cb-3d64-419b-a141-32a305cb058a', '6cee8c79-fe06-4fd9-b8c2-764752daa700', 'b97786e6-30c3-4a05-a741-ae9e216fcf75', '52f840bb-aee8-4534-a00a-5574f841d5dd'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:18 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:18 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:18 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.info" returned: 0 in 0.335s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6f472991-1aeb-4367-bb17-18ad6a89d7f6 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:20:18 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.365s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Deleted volume successfully. Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e8bccbf6-3a6e-4b54-b7ab-14223ac2b1cc tempest-ProjectReaderTests-270232278 None] Lock "cinder-3f55a9fd-932a-4207-a580-bf22b347d3c2-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (925c7922-ce14-4060-9087-1064c28230ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2233772f-c8b8-4d51-95a0-ce53e33346cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2233772f-c8b8-4d51-95a0-ce53e33346cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745675674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9920b95-77ba-466d-92ff-8fb69362f456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:19Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66157c98-43dd-4443-8674-6773612e217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66157c98-43dd-4443-8674-6773612e217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d50ca0-061a-46e4-b007-2a176300ad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d50ca0-061a-46e4-b007-2a176300ad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9920b95-77ba-466d-92ff-8fb69362f456', 'volume_name': 'volume-e9920b95-77ba-466d-92ff-8fb69362f456', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a5d8ca-aa93-4d6f-b860-c5eee21bed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a5d8ca-aa93-4d6f-b860-c5eee21bed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab1224c-e1dd-4a3f-bf07-d6da6e5a944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:18 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Volume e9920b95-77ba-466d-92ff-8fb69362f456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9920b95-77ba-466d-92ff-8fb69362f456', 'volume_size': 1} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745675674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9920b95-77ba-466d-92ff-8fb69362f456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:19Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Creating volume e9920b95-77ba-466d-92ff-8fb69362f456 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:18 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-e18c186b-8fd1-4e47-9f50-3dab234e352c-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-e18c186b-8fd1-4e47-9f50-3dab234e352c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:18 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 1073741824 Sep 11 23:20:18 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-e18c186b-8fd1-4e47-9f50-3dab234e352c" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-e18c186b-8fd1-4e47-9f50-3dab234e352c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot e18c186b-8fd1-4e47-9f50-3dab234e352c of volume 41f38ab1-2eb9-4697-816b-f4e4fc85daf3 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40be676a-3d37-436f-8dd7-000e4ad0e429]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:19 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c Sep 11 23:20:19 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:19 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c" returned: 0 in 0.429s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:19 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 1073741824" returned: 0 in 0.583s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4e53d9-ac81-4655-8ad6-6d235930eedd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:19 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 Sep 11 23:20:19 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:19 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 Sep 11 23:20:19 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:19 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456" returned: 0 in 0.335s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab1224c-e1dd-4a3f-bf07-d6da6e5a944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9920b95-77ba-466d-92ff-8fb69362f456', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0c0a4b-82ce-4b99-9a39-829ca3ee450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:19 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Volume volume-e9920b95-77ba-466d-92ff-8fb69362f456 (e9920b95-77ba-466d-92ff-8fb69362f456): created successfully Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0c0a4b-82ce-4b99-9a39-829ca3ee450f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (925c7922-ce14-4060-9087-1064c28230ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:19 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-908eb390-be7c-408f-b12b-274c61a40588 tempest-ProjectReaderTests-270232278 None] Created volume successfully. Sep 11 23:20:19 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" returned: 0 in 0.485s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:19 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c Sep 11 23:20:19 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:20 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c" returned: 0 in 0.400s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:20 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c Sep 11 23:20:20 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:20 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3.e18c186b-8fd1-4e47-9f50-3dab234e352c" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-e18c186b-8fd1-4e47-9f50-3dab234e352c" released by "_delete_snapshot" :: held 1.705s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" released by "delete_snapshot" :: held 1.729s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:20 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Created reservations ['22013a0b-d14e-41ad-92a7-c272b228e5a1', '2939e7cf-46b5-4cd5-9c9c-87ba882e6477', 'dc6125f6-859e-457d-a22b-c220477d6271', '218f6716-dfc3-4e4b-a984-8945d56f8b86'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:20:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3e9fe4-199c-4d7a-9115-fdc7a6f9a65e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-e18c186b-8fd1-4e47-9f50-3dab234e352c-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-41f38ab1-2eb9-4697-816b-f4e4fc85daf3-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-41f38ab1-2eb9-4697-816b-f4e4fc85daf3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Creating offline snapshot 5c754041-78ae-4164-8d1e-1bc38b7dc58c of volume e9920b95-77ba-466d-92ff-8fb69362f456 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9648bb78-4184-4630-bcff-cf7e53b3d283]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c07164-8808-466e-8437-e78f8d7b8605]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:21 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 Sep 11 23:20:21 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:21 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 Sep 11 23:20:21 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:21 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456" returned: 0 in 0.529s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:21 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" returned: 0 in 0.469s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:21 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:21 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c 1G Sep 11 23:20:21 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:21 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3 Sep 11 23:20:21 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:22 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" returned: 0 in 0.324s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-41f38ab1-2eb9-4697-816b-f4e4fc85daf3" released by "delete_volume" :: held 0.860s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Created reservations ['463bb2a9-cfd0-4c83-a015-b9a873ea8cb3', '5983e6a6-fcba-4476-9afe-45e49631861a', '36e3ae3f-421f-4d26-a940-5e6b508ff4df', '8be0b6b3-f746-49b8-873b-f76c96afcceb'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:22 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:22 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:22 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c 1G" returned: 0 in 0.578s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9920b95-77ba-466d-92ff-8fb69362f456 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:22 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9920b95-77ba-466d-92ff-8fb69362f456 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c Sep 11 23:20:22 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:22 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.277s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:22 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-28c89b89-e516-4e5c-9d34-f4c576578847 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-41f38ab1-2eb9-4697-816b-f4e4fc85daf3-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:22 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9920b95-77ba-466d-92ff-8fb69362f456 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c" returned: 0 in 0.516s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:22 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c is being set with open permissions: ugo+rw Sep 11 23:20:22 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:22 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c Sep 11 23:20:22 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (86eec35e-46bd-4f31-bb54-4e88431bcc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d270f7f-0dc5-409c-97d8-08e6f58154b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d270f7f-0dc5-409c-97d8-08e6f58154b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-214393756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2f66a5-614f-48f4-8bcb-66c5d3818545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:23Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:23 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92192a7c-8e45-4a14-a16c-e4d7eb8f1f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92192a7c-8e45-4a14-a16c-e4d7eb8f1f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02c74c6-1d4d-41f3-8c2f-078d150d1bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02c74c6-1d4d-41f3-8c2f-078d150d1bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2f66a5-614f-48f4-8bcb-66c5d3818545', 'volume_name': 'volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92511236-1eee-4647-95ae-e79a8fdaca25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92511236-1eee-4647-95ae-e79a8fdaca25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6fff2f-7167-4b33-9704-aea8cfdb1433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:23 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Volume fd2f66a5-614f-48f4-8bcb-66c5d3818545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545', 'volume_size': 1} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c" returned: 0 in 0.485s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:23 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.info Sep 11 23:20:23 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:23 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.info" returned: 0 in 0.279s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:23 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.info is being set with open permissions: ugo+rw Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:23 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.info Sep 11 23:20:23 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:23 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.info" returned: 0 in 0.336s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-214393756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2f66a5-614f-48f4-8bcb-66c5d3818545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:23Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Creating volume fd2f66a5-614f-48f4-8bcb-66c5d3818545 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:23 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:23 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:23 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 1073741824 Sep 11 23:20:23 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:23 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-abb87af3-baf8-4ec6-9172-834d25da4efe tempest-ProjectReaderTests-270232278 None] Create snapshot completed successfully Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-5c754041-78ae-4164-8d1e-1bc38b7dc58c-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Lock "cinder-5c754041-78ae-4164-8d1e-1bc38b7dc58c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-e9920b95-77ba-466d-92ff-8fb69362f456" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-e9920b95-77ba-466d-92ff-8fb69362f456" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-5c754041-78ae-4164-8d1e-1bc38b7dc58c" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-5c754041-78ae-4164-8d1e-1bc38b7dc58c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Deleting offline snapshot 5c754041-78ae-4164-8d1e-1bc38b7dc58c of volume e9920b95-77ba-466d-92ff-8fb69362f456 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] snapshot_file for this snap is: volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea71380-7df1-4cde-9d03-0750874565b6]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:24 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 1073741824" returned: 0 in 0.582s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:24 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c Sep 11 23:20:24 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:24 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 Sep 11 23:20:24 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:24 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c" returned: 0 in 0.460s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:24 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9920b95-77ba-466d-92ff-8fb69362f456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545" returned: 0 in 0.344s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6fff2f-7167-4b33-9704-aea8cfdb1433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f71f497-a51e-4ed0-9528-39aafb7d8288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[435dc286-a695-4114-8d42-5d806d20b59b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:24 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Volume volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 (fd2f66a5-614f-48f4-8bcb-66c5d3818545): created successfully Sep 11 23:20:24 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f71f497-a51e-4ed0-9528-39aafb7d8288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (86eec35e-46bd-4f31-bb54-4e88431bcc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:25 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-ed3c6181-1352-43ac-ab4f-f2f47ed47a7d tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:20:25 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 Sep 11 23:20:25 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:25 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456" returned: 0 in 0.499s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:25 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c Sep 11 23:20:25 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot d12cb697-4cb5-4646-bb48-f156d3583831 of volume fd2f66a5-614f-48f4-8bcb-66c5d3818545 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[080759cc-1881-423a-aac6-7fe8dcfdc50e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:25 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 Sep 11 23:20:25 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:25 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c" returned: 0 in 0.505s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:25 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:25 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c Sep 11 23:20:25 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:26 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545" returned: 0 in 0.481s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:26 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 1G Sep 11 23:20:26 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:26 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456.5c754041-78ae-4164-8d1e-1bc38b7dc58c" returned: 0 in 0.371s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-5c754041-78ae-4164-8d1e-1bc38b7dc58c" released by "_delete_snapshot" :: held 1.996s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-e9920b95-77ba-466d-92ff-8fb69362f456" released by "delete_snapshot" :: held 2.025s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Created reservations ['4b11b072-f148-4883-ba48-40e5eab58007', '235e89c6-c091-4832-8dbe-48ea685e65c9', 'f29111c3-f0bc-4977-b461-89d9fe6f6f49', '8a5257be-c32b-4460-9cb4-cc620b077fe2'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:26 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Delete snapshot completed successfully. Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4e56ebfb-be19-46b5-b3d0-c1a0d22e4d86 tempest-ProjectReaderTests-270232278 None] Lock "cinder-5c754041-78ae-4164-8d1e-1bc38b7dc58c-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:26 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 1G" returned: 0 in 0.544s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:26 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 Sep 11 23:20:26 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:26 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831" returned: 0 in 0.374s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:26 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 is being set with open permissions: ugo+rw Sep 11 23:20:26 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:27 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 Sep 11 23:20:27 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:27 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831" returned: 0 in 0.252s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:27 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.info Sep 11 23:20:27 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:27 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.info" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:27 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.info is being set with open permissions: ugo+rw Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:27 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.info Sep 11 23:20:27 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-e9920b95-77ba-466d-92ff-8fb69362f456-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Lock "cinder-e9920b95-77ba-466d-92ff-8fb69362f456-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-e9920b95-77ba-466d-92ff-8fb69362f456" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-e9920b95-77ba-466d-92ff-8fb69362f456" acquired by "delete_volume" :: waited 0.037s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01020859-716e-4247-9188-e9579d84740e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:27 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.info" returned: 0 in 0.322s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:27 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:27 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d0f0ffd1-5606-4c44-b691-7a7803a24379 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:20:27 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 Sep 11 23:20:27 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:28 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456" returned: 0 in 0.453s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:28 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456 Sep 11 23:20:28 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:28 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-e9920b95-77ba-466d-92ff-8fb69362f456" returned: 0 in 0.272s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-e9920b95-77ba-466d-92ff-8fb69362f456" released by "delete_volume" :: held 0.831s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Created reservations ['7bb49bf1-d586-48f8-bf8f-ed3f1d34a127', 'dd015e2e-39b1-4e37-806b-33eed11c2a6c', '7bbdd5b0-fa0a-4d57-bef7-9289b7c84bc8', '016e830f-764a-43a3-9002-66ceba0c04bb'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-d12cb697-4cb5-4646-bb48-f156d3583831-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-d12cb697-4cb5-4646-bb48-f156d3583831-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-fd2f66a5-614f-48f4-8bcb-66c5d3818545" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:28 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:28 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-fd2f66a5-614f-48f4-8bcb-66c5d3818545" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-d12cb697-4cb5-4646-bb48-f156d3583831" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-d12cb697-4cb5-4646-bb48-f156d3583831" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot d12cb697-4cb5-4646-bb48-f156d3583831 of volume fd2f66a5-614f-48f4-8bcb-66c5d3818545 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5f6b81-e895-4e9f-bb39-a7ceffac7ad8]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:28 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:29 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 Sep 11 23:20:29 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:29 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.472s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:29 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Deleted volume successfully. Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-04d1e4cc-8bdb-4cc0-8f78-926b58629ac1 tempest-ProjectReaderTests-270232278 None] Lock "cinder-e9920b95-77ba-466d-92ff-8fb69362f456-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:29 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831" returned: 0 in 0.525s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8357ff1-43fb-4c12-94fd-b21ae25b248b]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:29 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 Sep 11 23:20:29 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (6622d711-77e9-43a7-9d17-b9479e17e3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e206e5ba-a8b7-4925-9b40-e1420af75a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e206e5ba-a8b7-4925-9b40-e1420af75a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173619782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c9a163-6757-430c-a8f6-b0a5e5494b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:30Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3d0738-1709-46d7-9e24-33598c5bda48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3d0738-1709-46d7-9e24-33598c5bda48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3d6917-439e-4336-895d-fef699e2b968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3d6917-439e-4336-895d-fef699e2b968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c9a163-6757-430c-a8f6-b0a5e5494b62', 'volume_name': 'volume-58c9a163-6757-430c-a8f6-b0a5e5494b62', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a742d40d-0ec2-4eb3-b47a-ef623da201cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a742d40d-0ec2-4eb3-b47a-ef623da201cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67961e8-d80f-4afb-aee7-536d9f9058b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:29 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Volume 58c9a163-6757-430c-a8f6-b0a5e5494b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c9a163-6757-430c-a8f6-b0a5e5494b62', 'volume_size': 1} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173619782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c9a163-6757-430c-a8f6-b0a5e5494b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:30Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Creating volume 58c9a163-6757-430c-a8f6-b0a5e5494b62 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:29 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:29 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 1073741824 Sep 11 23:20:29 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:29 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545" returned: 0 in 0.418s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:29 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:29 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 Sep 11 23:20:29 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:30 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 1073741824" returned: 0 in 0.480s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:30 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831" returned: 0 in 0.423s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:30 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831 Sep 11 23:20:30 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:30 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 Sep 11 23:20:30 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:30 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62" returned: 0 in 0.355s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:30 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67961e8-d80f-4afb-aee7-536d9f9058b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c9a163-6757-430c-a8f6-b0a5e5494b62', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2343b946-76ab-45fe-ae8a-9f42c3692852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545.d12cb697-4cb5-4646-bb48-f156d3583831" returned: 0 in 0.436s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-d12cb697-4cb5-4646-bb48-f156d3583831" released by "_delete_snapshot" :: held 1.912s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:30 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Volume volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 (58c9a163-6757-430c-a8f6-b0a5e5494b62): created successfully Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2343b946-76ab-45fe-ae8a-9f42c3692852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (6622d711-77e9-43a7-9d17-b9479e17e3b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-fd2f66a5-614f-48f4-8bcb-66c5d3818545" released by "delete_snapshot" :: held 1.961s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-a98e2697-c352-4cbe-819d-558bd18eed46 tempest-ProjectReaderTests-270232278 None] Created volume successfully. Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Created reservations ['af448edc-28f0-472e-b2f3-d4dd7ca0fa48', 'df15cc98-8bd7-4fb7-b9dd-1e6bdf1af5cd', 'f9fd2235-f407-4673-bd1a-d6be5dbc1c56', 'f8cc27b5-9781-4fd4-9ade-a04422025a9d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:30 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:20:30 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5281dd14-fbf3-4f83-b4c9-795ca3a69d7e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-d12cb697-4cb5-4646-bb48-f156d3583831-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-fd2f66a5-614f-48f4-8bcb-66c5d3818545-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-fd2f66a5-614f-48f4-8bcb-66c5d3818545-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-fd2f66a5-614f-48f4-8bcb-66c5d3818545" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-fd2f66a5-614f-48f4-8bcb-66c5d3818545" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dbdadf-24a8-4321-8f6a-4285cbf938ee]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:31 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 Sep 11 23:20:31 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Creating offline snapshot 3d1e4edf-787e-4134-845d-f08192505893 of volume 58c9a163-6757-430c-a8f6-b0a5e5494b62 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[289c2545-056e-43f7-9ee5-dce8fef11413]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:31 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:32 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 Sep 11 23:20:32 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:32 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545" returned: 0 in 0.402s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:32 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545 Sep 11 23:20:32 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:32 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62" returned: 0 in 0.394s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:32 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 1G Sep 11 23:20:32 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:32 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-fd2f66a5-614f-48f4-8bcb-66c5d3818545" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-fd2f66a5-614f-48f4-8bcb-66c5d3818545" released by "delete_volume" :: held 0.760s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Created reservations ['750bcde6-5368-40fe-9999-f53dd98063bf', '6e3de4e0-3243-4c04-8d4f-1594b40f31e8', '51d73241-9fe6-43f5-9e64-d344920b26f5', '6c80d016-6257-4ffc-936a-30e9c5b08fec'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:32 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:32 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:32 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 1G" returned: 0 in 0.542s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:32 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 Sep 11 23:20:32 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:32 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.356s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:32 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:20:32 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-f931974e-7252-4a3f-ac4c-193e9ed8c161 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-fd2f66a5-614f-48f4-8bcb-66c5d3818545-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:33 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893" returned: 0 in 0.362s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:33 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 is being set with open permissions: ugo+rw Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:33 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 Sep 11 23:20:33 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (a5ed2140-fa96-4e62-a9b2-3d6cdec145dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abe711d-655b-4316-bd01-f812b8d6ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abe711d-655b-4316-bd01-f812b8d6ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-896918010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f30718-94ba-42e4-a165-8c0dbbe6e7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:33Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceda25b3-23f0-4e16-843c-eb943ff2f54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceda25b3-23f0-4e16-843c-eb943ff2f54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d0bba9-fc50-4fcd-9270-b360986e7144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d0bba9-fc50-4fcd-9270-b360986e7144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f30718-94ba-42e4-a165-8c0dbbe6e7a7', 'volume_name': 'volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ad85d3-4f76-4214-af79-590416f7a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07ad85d3-4f76-4214-af79-590416f7a235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f9c322-56f0-41b0-86f6-32fdc4e92f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:33 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Volume 81f30718-94ba-42e4-a165-8c0dbbe6e7a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7', 'volume_size': 1} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:33 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893" returned: 0 in 0.289s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:33 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.info Sep 11 23:20:33 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:33 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.info" returned: 0 in 0.285s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:33 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.info is being set with open permissions: ugo+rw Sep 11 23:20:33 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:33 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.info Sep 11 23:20:33 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:34 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.info" returned: 0 in 0.291s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-896918010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f30718-94ba-42e4-a165-8c0dbbe6e7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:33Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Creating volume 81f30718-94ba-42e4-a165-8c0dbbe6e7a7 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:34 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:34 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 1073741824 Sep 11 23:20:34 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6c971a88-b795-46f7-91a3-6763cd237410 tempest-ProjectReaderTests-270232278 None] Create snapshot completed successfully Sep 11 23:20:34 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 1073741824" returned: 0 in 0.454s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:34 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 Sep 11 23:20:34 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:34 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" returned: 0 in 0.275s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f9c322-56f0-41b0-86f6-32fdc4e92f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb21f6d-a11f-4a5d-8516-bd24a92e054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:34 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Volume volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 (81f30718-94ba-42e4-a165-8c0dbbe6e7a7): created successfully Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb21f6d-a11f-4a5d-8516-bd24a92e054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:34 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (a5ed2140-fa96-4e62-a9b2-3d6cdec145dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:34 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-27c04093-cfdd-4878-b72e-c7e5539b2e74 tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-3d1e4edf-787e-4134-845d-f08192505893-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Lock "cinder-3d1e4edf-787e-4134-845d-f08192505893-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-58c9a163-6757-430c-a8f6-b0a5e5494b62" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-58c9a163-6757-430c-a8f6-b0a5e5494b62" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-3d1e4edf-787e-4134-845d-f08192505893" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-3d1e4edf-787e-4134-845d-f08192505893" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Deleting offline snapshot 3d1e4edf-787e-4134-845d-f08192505893 of volume 58c9a163-6757-430c-a8f6-b0a5e5494b62 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] snapshot_file for this snap is: volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9411251-7d4a-4810-9121-0fd340d44f31]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:35 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 Sep 11 23:20:35 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot c540e6df-5002-475e-a066-4ad9849c257c of volume 81f30718-94ba-42e4-a165-8c0dbbe6e7a7 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6835678-4c46-4297-8ee4-dd80f9495b87]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:35 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893" returned: 0 in 0.461s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58c9a163-6757-430c-a8f6-b0a5e5494b62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b601f176-6ca6-41d4-939b-7be421cfa6b1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:35 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:35 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 Sep 11 23:20:35 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:35 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 Sep 11 23:20:35 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:36 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" returned: 0 in 0.428s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:36 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c 1G Sep 11 23:20:36 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:36 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62" returned: 0 in 0.450s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:36 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 Sep 11 23:20:36 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:36 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c 1G" returned: 0 in 0.464s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:36 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:36 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c Sep 11 23:20:36 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:36 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893 Sep 11 23:20:36 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:36 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62.3d1e4edf-787e-4134-845d-f08192505893" returned: 0 in 0.281s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-3d1e4edf-787e-4134-845d-f08192505893" released by "_delete_snapshot" :: held 1.710s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-58c9a163-6757-430c-a8f6-b0a5e5494b62" released by "delete_snapshot" :: held 1.736s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:36 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c" returned: 0 in 0.369s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:36 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c is being set with open permissions: ugo+rw Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:36 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c Sep 11 23:20:36 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:36 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Created reservations ['6cb1c709-6edd-4d1e-9b18-58482bd2e43d', '46c9daf0-287a-4e8d-adae-d22bbcb04340', 'bbeeb0f5-fed6-4769-878d-38d0b3950d07', '0010fdfd-33e3-4975-b13b-10b02b70e3b8'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Delete snapshot completed successfully. Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-109d6aa5-298c-4650-b9b5-39e3f73e9b50 tempest-ProjectReaderTests-270232278 None] Lock "cinder-3d1e4edf-787e-4134-845d-f08192505893-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Flow 'volume_create_manager' (3083ab16-0cda-428a-bf98-b14ebd3e905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf8f231-aa2e-48cd-ba92-6d3322e1d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf8f231-aa2e-48cd-ba92-6d3322e1d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-190635775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6904b86-3f06-430b-8fcc-d48ba2e592c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027cc310994b45da8d0d36141ceb29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:37Z,use_quota=True,user_id='7ef184de42144398be08f6e7cea43444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adcec89-2572-4e83-8de3-4676b888e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adcec89-2572-4e83-8de3-4676b888e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7033acd0-63e4-4dae-9dde-2b69c14991ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7033acd0-63e4-4dae-9dde-2b69c14991ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6904b86-3f06-430b-8fcc-d48ba2e592c8', 'volume_name': 'volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9e5640-f2c1-4f91-80c3-cefcb76942da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9e5640-f2c1-4f91-80c3-cefcb76942da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be274f63-05a9-4a23-b2bb-6b7ca7a21555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:37 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Volume a6904b86-3f06-430b-8fcc-d48ba2e592c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8', 'volume_size': 1} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:37 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c" returned: 0 in 0.286s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:37 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.info Sep 11 23:20:37 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-58c9a163-6757-430c-a8f6-b0a5e5494b62-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Lock "cinder-58c9a163-6757-430c-a8f6-b0a5e5494b62-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-58c9a163-6757-430c-a8f6-b0a5e5494b62" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-58c9a163-6757-430c-a8f6-b0a5e5494b62" acquired by "delete_volume" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d5308e-03f7-4a37-9621-5bac9a23bcd7]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:37 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.info" returned: 0 in 0.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:37 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.info is being set with open permissions: ugo+rw Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:37 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.info Sep 11 23:20:37 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:37 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 Sep 11 23:20:37 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:37 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.info" returned: 0 in 0.270s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.599s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-190635775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6904b86-3f06-430b-8fcc-d48ba2e592c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027cc310994b45da8d0d36141ceb29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:37Z,use_quota=True,user_id='7ef184de42144398be08f6e7cea43444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Creating volume a6904b86-3f06-430b-8fcc-d48ba2e592c8 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:37 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:37 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 1073741824 Sep 11 23:20:37 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:37 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c6c5c9f5-e5ab-466b-8416-23a0300a39f4 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:20:37 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62" returned: 0 in 0.417s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:37 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:37 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62 Sep 11 23:20:37 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:38 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-58c9a163-6757-430c-a8f6-b0a5e5494b62" returned: 0 in 0.260s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-58c9a163-6757-430c-a8f6-b0a5e5494b62" released by "delete_volume" :: held 0.737s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Created reservations ['89a2dd9d-9476-48b2-a159-32703a0717a4', '6c3da38f-5eaa-4333-b8b9-bba083b26af6', '798039b9-e31e-4bb9-80f6-ccce74215a94', 'f58777b3-a219-4ed0-bef7-aedcd2968d87'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:38 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 1073741824" returned: 0 in 0.466s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:38 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:38 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:38 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 Sep 11 23:20:38 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:38 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.255s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:38 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Deleted volume successfully. Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d83bcf46-876a-4119-8b0f-0c1d8c72c983 tempest-ProjectReaderTests-270232278 None] Lock "cinder-58c9a163-6757-430c-a8f6-b0a5e5494b62-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:38 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8" returned: 0 in 0.261s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be274f63-05a9-4a23-b2bb-6b7ca7a21555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d8f9e5-3b1b-4722-b618-09c903ac8c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:38 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Volume volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 (a6904b86-3f06-430b-8fcc-d48ba2e592c8): created successfully Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d8f9e5-3b1b-4722-b618-09c903ac8c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Flow 'volume_create_manager' (3083ab16-0cda-428a-bf98-b14ebd3e905b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:38 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-127297ef-93b7-4c69-a07a-8050dc7d6113 tempest-ProjectReaderTests-1011049028 None] Created volume successfully. Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-c540e6df-5002-475e-a066-4ad9849c257c-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Lock "cinder-c540e6df-5002-475e-a066-4ad9849c257c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-c540e6df-5002-475e-a066-4ad9849c257c" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-c540e6df-5002-475e-a066-4ad9849c257c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot c540e6df-5002-475e-a066-4ad9849c257c of volume 81f30718-94ba-42e4-a165-8c0dbbe6e7a7 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b91fb55-b5c6-4d33-a6bd-03b54ee0f1ea]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:38 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:39 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c Sep 11 23:20:39 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (797d5dee-18f5-43c3-92b8-161ce2f1326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a988d59-4eb0-41f1-92eb-4aadfb33cc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a988d59-4eb0-41f1-92eb-4aadfb33cc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771644578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e36867c-7f51-4b89-9ce4-fb574678d885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:39Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6657dc5-6cc8-4117-a675-a964402a702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6657dc5-6cc8-4117-a675-a964402a702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd206ec8-3e29-4705-a52c-7fa7deaa894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd206ec8-3e29-4705-a52c-7fa7deaa894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e36867c-7f51-4b89-9ce4-fb574678d885', 'volume_name': 'volume-5e36867c-7f51-4b89-9ce4-fb574678d885', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46196e41-a01c-4749-9fd2-2d1bc5caba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46196e41-a01c-4749-9fd2-2d1bc5caba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0085f953-8dc8-4888-add4-a2a6935dc109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:39 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Volume 5e36867c-7f51-4b89-9ce4-fb574678d885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e36867c-7f51-4b89-9ce4-fb574678d885', 'volume_size': 1} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771644578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e36867c-7f51-4b89-9ce4-fb574678d885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:39Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Creating volume 5e36867c-7f51-4b89-9ce4-fb574678d885 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:39 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:39 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 1073741824 Sep 11 23:20:39 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:39 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c" returned: 0 in 0.454s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Acquiring lock "cinder-a6904b86-3f06-430b-8fcc-d48ba2e592c8-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13dddff-2c66-4a70-9b86-4c0178ea3013]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Lock "cinder-a6904b86-3f06-430b-8fcc-d48ba2e592c8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Acquiring lock "cinder-quobyte-a6904b86-3f06-430b-8fcc-d48ba2e592c8" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Lock "cinder-quobyte-a6904b86-3f06-430b-8fcc-d48ba2e592c8" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec54a98-93a1-4882-8349-7eef53fd4f49]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:39 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 Sep 11 23:20:39 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:39 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 Sep 11 23:20:39 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:39 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 1073741824" returned: 0 in 0.517s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:39 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 Sep 11 23:20:39 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:39 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" returned: 0 in 0.437s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:39 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c Sep 11 23:20:39 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:39 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8" returned: 0 in 0.441s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:39 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:40 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8 Sep 11 23:20:40 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:40 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885" returned: 0 in 0.291s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0085f953-8dc8-4888-add4-a2a6935dc109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e36867c-7f51-4b89-9ce4-fb574678d885', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa1c395-5aee-4221-9cf4-f297c9f4ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:40 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Volume volume-5e36867c-7f51-4b89-9ce4-fb574678d885 (5e36867c-7f51-4b89-9ce4-fb574678d885): created successfully Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa1c395-5aee-4221-9cf4-f297c9f4ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (797d5dee-18f5-43c3-92b8-161ce2f1326a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-28fdd5a8-cb94-4ba2-8216-bbf860030610 tempest-ProjectReaderTests-270232278 None] Created volume successfully. Sep 11 23:20:40 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c" returned: 0 in 0.361s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:40 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c Sep 11 23:20:40 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:40 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-a6904b86-3f06-430b-8fcc-d48ba2e592c8" returned: 0 in 0.277s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Lock "cinder-quobyte-a6904b86-3f06-430b-8fcc-d48ba2e592c8" released by "delete_volume" :: held 0.756s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Created reservations ['2b8e1552-f5d0-4e14-8f4b-e75133cc3bdb', 'b69725f1-bb5a-416a-a874-f681d9d08545', 'f664281e-cf49-4700-9d5f-f0fdb6cc1e1c', 'a51f03f5-f819-4314-9326-64b02fe6040c'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:40 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:40 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:40 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7.c540e6df-5002-475e-a066-4ad9849c257c" returned: 0 in 0.277s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-c540e6df-5002-475e-a066-4ad9849c257c" released by "_delete_snapshot" :: held 1.694s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" released by "delete_snapshot" :: held 1.727s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Created reservations ['9250b1ae-56d7-478a-b1b0-4851055df02e', '8e6c602c-06d2-4577-97a6-7f2509daa32e', '9277f4ca-b742-4f97-b002-c97f5085000a', '5fab2eef-5388-4b41-a399-985b7b6581fa'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:20:40 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-959f1adb-26c5-4356-a3e0-d343b09193ec tempest-ProjectMemberTests-1931110376 None] Lock "cinder-c540e6df-5002-475e-a066-4ad9849c257c-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.293s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:40 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Deleted volume successfully. Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-98a6b1e2-e273-436f-a8b3-1f91c6b08734 tempest-ProjectReaderTests-1011049028 None] Lock "cinder-a6904b86-3f06-430b-8fcc-d48ba2e592c8-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-81f30718-94ba-42e4-a165-8c0dbbe6e7a7-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:40 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-81f30718-94ba-42e4-a165-8c0dbbe6e7a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa075634-366e-4a7e-91df-7c2bd7f98425]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Flow 'volume_create_manager' (07fac4bf-dd78-4bed-9648-11439bc99642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897876d1-5497-42df-883e-af4485db1463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897876d1-5497-42df-883e-af4485db1463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231040060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7485d4d0-dd6d-4c1b-a147-943ce9346ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027cc310994b45da8d0d36141ceb29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:41Z,use_quota=True,user_id='7ef184de42144398be08f6e7cea43444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5297f5-3775-41e1-9fad-62762289d4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5297f5-3775-41e1-9fad-62762289d4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefea9de-c403-4e66-acdc-e1a374c0c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefea9de-c403-4e66-acdc-e1a374c0c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7485d4d0-dd6d-4c1b-a147-943ce9346ac4', 'volume_name': 'volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3ebf66-c506-4060-bf19-c2dfc6b5a250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:41 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 Sep 11 23:20:41 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3ebf66-c506-4060-bf19-c2dfc6b5a250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22accfb-d2dd-455e-a4f5-0139dd04d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:41 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Volume 7485d4d0-dd6d-4c1b-a147-943ce9346ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4', 'volume_size': 1} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231040060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7485d4d0-dd6d-4c1b-a147-943ce9346ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027cc310994b45da8d0d36141ceb29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:41Z,use_quota=True,user_id='7ef184de42144398be08f6e7cea43444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Creating volume 7485d4d0-dd6d-4c1b-a147-943ce9346ac4 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:41 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:41 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 1073741824 Sep 11 23:20:41 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:41 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" returned: 0 in 0.407s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:41 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7 Sep 11 23:20:41 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:41 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 1073741824" returned: 0 in 0.465s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:41 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 Sep 11 23:20:41 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:41 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" returned: 0 in 0.300s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-81f30718-94ba-42e4-a165-8c0dbbe6e7a7" released by "delete_volume" :: held 0.796s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Created reservations ['b67b4c4c-5b41-4100-81a6-cdd051dd0490', 'df04db56-92e7-46c8-8ce5-98ebff67dc56', '7c04cd74-d113-42d6-ab59-1ef4d3d0eceb', '9c0e0ffc-fe84-409c-9477-ca50747dc8a0'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:41 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:41 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:41 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:42 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4" returned: 0 in 0.292s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.710s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22accfb-d2dd-455e-a4f5-0139dd04d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea1d021-8138-47d4-b263-b1fd46c102ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Creating offline snapshot 2f94f9b5-98d2-41bb-b531-d906c26eceab of volume 5e36867c-7f51-4b89-9ce4-fb574678d885 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Volume volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 (7485d4d0-dd6d-4c1b-a147-943ce9346ac4): created successfully Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea1d021-8138-47d4-b263-b1fd46c102ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Flow 'volume_create_manager' (07fac4bf-dd78-4bed-9648-11439bc99642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[70040d4a-e312-45e4-924e-b31a6feee734]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-19dc893e-09a0-48ef-acb1-01a119401297 tempest-ProjectReaderTests-1011049028 None] Created volume successfully. Sep 11 23:20:42 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:42 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:20:42 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 Sep 11 23:20:42 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-29cd7688-8678-4c84-857d-bf7ef6b6d307 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-81f30718-94ba-42e4-a165-8c0dbbe6e7a7-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:42 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885" returned: 0 in 0.429s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:42 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab 1G Sep 11 23:20:42 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (4c7d2331-ac7b-4e51-8fe5-a45770bc226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb74d44-5365-4f2c-8d18-87a497106e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb74d44-5365-4f2c-8d18-87a497106e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468711605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8972b4f0-b08c-4dc3-9196-62e6c7d00d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:43Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79075ec2-6414-488d-aa9c-bac5cf3b72e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79075ec2-6414-488d-aa9c-bac5cf3b72e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1463cc3-75b8-4834-ac41-387e499e0c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1463cc3-75b8-4834-ac41-387e499e0c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8972b4f0-b08c-4dc3-9196-62e6c7d00d58', 'volume_name': 'volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97617d99-cac4-46c3-b65b-c41da1e135d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97617d99-cac4-46c3-b65b-c41da1e135d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133523e0-c8b7-4f17-a48b-30b70c278324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:42 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Volume 8972b4f0-b08c-4dc3-9196-62e6c7d00d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58', 'volume_size': 1} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:42 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab 1G" returned: 0 in 0.391s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:42 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e36867c-7f51-4b89-9ce4-fb574678d885 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:42 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e36867c-7f51-4b89-9ce4-fb574678d885 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab Sep 11 23:20:42 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Acquiring lock "cinder-7485d4d0-dd6d-4c1b-a147-943ce9346ac4-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:43 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e36867c-7f51-4b89-9ce4-fb574678d885 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab" returned: 0 in 0.304s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:43 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab is being set with open permissions: ugo+rw Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Lock "cinder-7485d4d0-dd6d-4c1b-a147-943ce9346ac4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:43 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab Sep 11 23:20:43 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Acquiring lock "cinder-quobyte-7485d4d0-dd6d-4c1b-a147-943ce9346ac4" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Lock "cinder-quobyte-7485d4d0-dd6d-4c1b-a147-943ce9346ac4" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb6d71-f882-4bdc-9174-f2bc91654960]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:43 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 Sep 11 23:20:43 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:43 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab" returned: 0 in 0.274s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:43 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.info Sep 11 23:20:43 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:43 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4" returned: 0 in 0.398s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:43 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4 Sep 11 23:20:43 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:43 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.info" returned: 0 in 0.292s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:43 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.info is being set with open permissions: ugo+rw Sep 11 23:20:43 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:43 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.info Sep 11 23:20:43 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:44 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-7485d4d0-dd6d-4c1b-a147-943ce9346ac4" returned: 0 in 0.267s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Lock "cinder-quobyte-7485d4d0-dd6d-4c1b-a147-943ce9346ac4" released by "delete_volume" :: held 0.711s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Created reservations ['50576de2-6b44-4dd2-abae-e0c15d4e3b2e', '48a3d3ab-96bd-4c8e-b737-d27e76c9e7b8', '5d3a4116-1733-454a-bd47-e7c5abc5a04c', '8c5a5f81-2af4-47ac-891a-9b09e4ee21e5'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:44 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.info" returned: 0 in 0.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468711605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8972b4f0-b08c-4dc3-9196-62e6c7d00d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:43Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Creating volume 8972b4f0-b08c-4dc3-9196-62e6c7d00d58 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:44 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:44 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 1073741824 Sep 11 23:20:44 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6478d0ab-4bab-401d-aaab-c9212a90ac77 tempest-ProjectReaderTests-270232278 None] Create snapshot completed successfully Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:44 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:44 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:44 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.313s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-2f94f9b5-98d2-41bb-b531-d906c26eceab-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:44 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Deleted volume successfully. Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Lock "cinder-2f94f9b5-98d2-41bb-b531-d906c26eceab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-5e36867c-7f51-4b89-9ce4-fb574678d885" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-5e36867c-7f51-4b89-9ce4-fb574678d885" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-2f94f9b5-98d2-41bb-b531-d906c26eceab" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-d7c0f369-12da-45aa-aa46-4dbda104cf9d tempest-ProjectReaderTests-1011049028 None] Lock "cinder-7485d4d0-dd6d-4c1b-a147-943ce9346ac4-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-2f94f9b5-98d2-41bb-b531-d906c26eceab" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Deleting offline snapshot 2f94f9b5-98d2-41bb-b531-d906c26eceab of volume 5e36867c-7f51-4b89-9ce4-fb574678d885 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] snapshot_file for this snap is: volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a5a34-8590-4f2a-9616-1fcf023508f4]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:44 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 1073741824" returned: 0 in 0.646s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:44 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:44 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab Sep 11 23:20:44 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:44 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 Sep 11 23:20:44 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:45 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133523e0-c8b7-4f17-a48b-30b70c278324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a218d74-86f0-4cad-8437-a2206b11958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:45 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:45 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Volume volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 (8972b4f0-b08c-4dc3-9196-62e6c7d00d58): created successfully Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a218d74-86f0-4cad-8437-a2206b11958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (4c7d2331-ac7b-4e51-8fe5-a45770bc226d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab" returned: 0 in 0.449s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e36867c-7f51-4b89-9ce4-fb574678d885(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:45 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7da673e3-7992-4cd0-b0a6-44818f6ee0a4 tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[52faa730-9eeb-4271-a3ad-71ff5244ab33]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:45 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 Sep 11 23:20:45 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:45 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885" returned: 0 in 0.370s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:45 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:45 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab Sep 11 23:20:45 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:46 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab" returned: 0 in 0.466s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:46 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab Sep 11 23:20:46 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot 1ac4f55f-b1ca-4bea-93da-55258eea1e49 of volume 8972b4f0-b08c-4dc3-9196-62e6c7d00d58 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[942491bf-e73c-4835-b729-2da4faaacbd1]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:46 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 Sep 11 23:20:46 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:46 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885.2f94f9b5-98d2-41bb-b531-d906c26eceab" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-2f94f9b5-98d2-41bb-b531-d906c26eceab" released by "_delete_snapshot" :: held 1.726s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-5e36867c-7f51-4b89-9ce4-fb574678d885" released by "delete_snapshot" :: held 1.762s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Created reservations ['98165ab2-58fe-46e1-b1d8-1fc28155a476', 'df561817-930a-4480-8ab3-6083f5fa0d36', '26ada9f6-e23b-4ffe-85c6-75e04916d078', '7c83c6c0-f0ad-4249-9441-b0de6db56f4c'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:46 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Delete snapshot completed successfully. Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-6a3e60cc-5271-41fa-a06a-07c64e42e824 tempest-ProjectReaderTests-270232278 None] Lock "cinder-2f94f9b5-98d2-41bb-b531-d906c26eceab-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:46 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" returned: 0 in 0.461s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:46 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 1G Sep 11 23:20:46 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-5e36867c-7f51-4b89-9ce4-fb574678d885-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Lock "cinder-5e36867c-7f51-4b89-9ce4-fb574678d885-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-5e36867c-7f51-4b89-9ce4-fb574678d885" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-5e36867c-7f51-4b89-9ce4-fb574678d885" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfbf99e-471f-40f5-9b44-b79426cc868f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 1G" returned: 0 in 0.436s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 Sep 11 23:20:47 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:47 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 Sep 11 23:20:47 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:47 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49" returned: 0 in 0.296s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:47 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 is being set with open permissions: ugo+rw Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885" returned: 0 in 0.437s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 Sep 11 23:20:47 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:47 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885 Sep 11 23:20:47 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:47 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49" returned: 0 in 0.246s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:47 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5e36867c-7f51-4b89-9ce4-fb574678d885" returned: 0 in 0.271s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:47 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.info Sep 11 23:20:47 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-5e36867c-7f51-4b89-9ce4-fb574678d885" released by "delete_volume" :: held 0.770s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Created reservations ['09b8e10b-4492-4f6e-ad1e-606d27ff75e0', '6e2ec261-5fa2-4fbf-b4c4-3e61fb4096f0', '51af7d26-de3e-4adc-a7cb-9fbf3f491351', '93733692-65f0-4f4a-b0db-75fdfe5ffdd3'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:47 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:47 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.info" returned: 0 in 0.296s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:47 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.info is being set with open permissions: ugo+rw Sep 11 23:20:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:47 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.info Sep 11 23:20:47 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:48 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.258s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Deleted volume successfully. Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-305b6c24-ffbc-46e0-a153-e772e4669ec7 tempest-ProjectReaderTests-270232278 None] Lock "cinder-5e36867c-7f51-4b89-9ce4-fb574678d885-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:48 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.info" returned: 0 in 0.275s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:48 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1a893aea-8a5e-4fbb-a026-a27200aac8a9 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (0c0d8d4e-00ea-47e1-b65d-39f3539f0978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d888cd-49a3-453a-b9fd-901457bcb6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d888cd-49a3-453a-b9fd-901457bcb6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480421768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab561119-329e-41df-a41f-7cdbedcb9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:48Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e964f437-90f4-4f14-990d-f895de76506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e964f437-90f4-4f14-990d-f895de76506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be754775-483a-44f3-8c27-a029b7f6faec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be754775-483a-44f3-8c27-a029b7f6faec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab561119-329e-41df-a41f-7cdbedcb9272', 'volume_name': 'volume-ab561119-329e-41df-a41f-7cdbedcb9272', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3003e99a-9703-44ed-a0dc-e07b1f12f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3003e99a-9703-44ed-a0dc-e07b1f12f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ebf0b3-8089-4d23-9846-71a4ca8146f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:48 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Volume ab561119-329e-41df-a41f-7cdbedcb9272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab561119-329e-41df-a41f-7cdbedcb9272', 'volume_size': 1} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480421768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab561119-329e-41df-a41f-7cdbedcb9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00c5c2e0e34d6a8e116e28a0765438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:48Z,use_quota=True,user_id='1f399e80de2e4f88ad9fb5b314924872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Creating volume ab561119-329e-41df-a41f-7cdbedcb9272 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:48 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:48 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 1073741824 Sep 11 23:20:48 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:48 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 1073741824" returned: 0 in 0.432s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:49 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 Sep 11 23:20:49 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:49 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272" returned: 0 in 0.250s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-1ac4f55f-b1ca-4bea-93da-55258eea1e49-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ebf0b3-8089-4d23-9846-71a4ca8146f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab561119-329e-41df-a41f-7cdbedcb9272', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ac5273-5df6-4535-b75c-a2dbe592a39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-1ac4f55f-b1ca-4bea-93da-55258eea1e49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:49 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Volume volume-ab561119-329e-41df-a41f-7cdbedcb9272 (ab561119-329e-41df-a41f-7cdbedcb9272): created successfully Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ac5273-5df6-4535-b75c-a2dbe592a39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Flow 'volume_create_manager' (0c0d8d4e-00ea-47e1-b65d-39f3539f0978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-1ac4f55f-b1ca-4bea-93da-55258eea1e49" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:49 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-87563474-6fc1-484e-900d-4b6bb6ded576 tempest-ProjectReaderTests-270232278 None] Created volume successfully. Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-1ac4f55f-b1ca-4bea-93da-55258eea1e49" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot 1ac4f55f-b1ca-4bea-93da-55258eea1e49 of volume 8972b4f0-b08c-4dc3-9196-62e6c7d00d58 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e094bde8-9597-40d7-b2f5-ce1490c09fd9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:49 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 Sep 11 23:20:49 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Creating offline snapshot cb04b1b3-609c-4a52-a815-62c195d191f3 of volume ab561119-329e-41df-a41f-7cdbedcb9272 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c44c08-8812-4931-924b-e472cf823b54]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:49 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 Sep 11 23:20:49 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:49 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49" returned: 0 in 0.415s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b549314e-5a37-446b-b031-afdacf56d8ac]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:49 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 Sep 11 23:20:49 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:50 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272" returned: 0 in 0.386s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:50 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 1G Sep 11 23:20:50 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:50 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" returned: 0 in 0.367s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:50 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 Sep 11 23:20:50 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:50 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 1G" returned: 0 in 0.419s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab561119-329e-41df-a41f-7cdbedcb9272 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:50 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab561119-329e-41df-a41f-7cdbedcb9272 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 Sep 11 23:20:50 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:50 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49" returned: 0 in 0.372s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:50 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49 Sep 11 23:20:50 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:50 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab561119-329e-41df-a41f-7cdbedcb9272 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3" returned: 0 in 0.318s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:50 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 is being set with open permissions: ugo+rw Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:50 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 Sep 11 23:20:50 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:50 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58.1ac4f55f-b1ca-4bea-93da-55258eea1e49" returned: 0 in 0.284s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-1ac4f55f-b1ca-4bea-93da-55258eea1e49" released by "_delete_snapshot" :: held 1.546s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" released by "delete_snapshot" :: held 1.578s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:50 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Created reservations ['8d432786-e5b4-4330-b256-477bf95f3b52', '02336a60-db24-49ce-803a-5e9c18f74701', '9171fed7-7e09-4976-9b7c-923e9f042da3', '63bde320-fb96-4718-b6b1-ef14ddd9b57d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-11c0ce7d-7254-460d-a684-231d7d050be7 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-1ac4f55f-b1ca-4bea-93da-55258eea1e49-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:51 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:51 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.info Sep 11 23:20:51 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:51 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.info" returned: 0 in 0.252s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:51 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.info is being set with open permissions: ugo+rw Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:51 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.info Sep 11 23:20:51 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-8972b4f0-b08c-4dc3-9196-62e6c7d00d58-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-8972b4f0-b08c-4dc3-9196-62e6c7d00d58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" acquired by "delete_volume" :: waited 0.023s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02002502-dbd4-4bfb-b9ef-ddfcde0ab744]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:51 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.info" returned: 0 in 0.257s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:51 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c657d6b4-e308-4dc6-ba00-82a9146930b5 tempest-ProjectReaderTests-270232278 None] Create snapshot completed successfully Sep 11 23:20:51 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 Sep 11 23:20:51 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-cb04b1b3-609c-4a52-a815-62c195d191f3-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Lock "cinder-cb04b1b3-609c-4a52-a815-62c195d191f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-ab561119-329e-41df-a41f-7cdbedcb9272" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-ab561119-329e-41df-a41f-7cdbedcb9272" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-cb04b1b3-609c-4a52-a815-62c195d191f3" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-cb04b1b3-609c-4a52-a815-62c195d191f3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Deleting offline snapshot cb04b1b3-609c-4a52-a815-62c195d191f3 of volume ab561119-329e-41df-a41f-7cdbedcb9272 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] snapshot_file for this snap is: volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d74ca0-2b7a-44b9-80ad-6bd0e72f2c6f]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:51 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" returned: 0 in 0.410s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:51 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58 Sep 11 23:20:51 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:52 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 Sep 11 23:20:52 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:52 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" returned: 0 in 0.256s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8972b4f0-b08c-4dc3-9196-62e6c7d00d58" released by "delete_volume" :: held 0.728s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Created reservations ['c55cfdb7-10c5-485c-bf52-0a185b20e816', 'a52bf975-8df9-4d05-a930-721d87d5fcc1', '9dd5b253-ec56-4072-b31d-fa34c56a4717', 'a046b78f-fa70-4011-9483-d1b45242de5b'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:52 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3" returned: 0 in 0.405s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab561119-329e-41df-a41f-7cdbedcb9272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e32cd2b-4538-4b20-9e53-5a96b36f46a5]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:52 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:52 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:52 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 Sep 11 23:20:52 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:52 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.278s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:52 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-e3e3e248-1220-4598-bef2-e22248216d03 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-8972b4f0-b08c-4dc3-9196-62e6c7d00d58-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:52 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272" returned: 0 in 0.450s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:52 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 Sep 11 23:20:52 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (76efee38-3028-48e9-a592-72b78392dd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5222781e-68fa-4355-a053-baad52d45523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5222781e-68fa-4355-a053-baad52d45523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121497036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bb9953-b1c2-4b41-8489-6b3dd8849cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:53Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc6e368-41b7-4b6d-8873-5325fd4cafdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc6e368-41b7-4b6d-8873-5325fd4cafdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90abd3fc-aa2c-4705-a6a1-7c2141fb08b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90abd3fc-aa2c-4705-a6a1-7c2141fb08b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bb9953-b1c2-4b41-8489-6b3dd8849cfe', 'volume_name': 'volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bd4b5f-4943-47ca-8114-1dfe2c04a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:53 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bd4b5f-4943-47ca-8114-1dfe2c04a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1708be-4e81-4fa0-ae28-84abd1e4e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:53 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Volume 10bb9953-b1c2-4b41-8489-6b3dd8849cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe', 'volume_size': 1} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121497036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bb9953-b1c2-4b41-8489-6b3dd8849cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:53Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Creating volume 10bb9953-b1c2-4b41-8489-6b3dd8849cfe {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:53 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3" returned: 0 in 0.423s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:53 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe 1073741824 Sep 11 23:20:53 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:53 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3 Sep 11 23:20:53 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:53 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272.cb04b1b3-609c-4a52-a815-62c195d191f3" returned: 0 in 0.262s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-cb04b1b3-609c-4a52-a815-62c195d191f3" released by "_delete_snapshot" :: held 1.641s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-ab561119-329e-41df-a41f-7cdbedcb9272" released by "delete_snapshot" :: held 1.666s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Created reservations ['79e4136e-3548-4329-8de0-d93a5f69316d', '7aeff6a6-0258-4789-a23e-c829dbc4b094', '5b99ba79-8150-4105-aadf-4ef80e01de0d', '8624e79e-993b-4c25-b919-7a814efc457d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:53 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Delete snapshot completed successfully. Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3ed73c6e-ba81-4b5c-bee3-b2984c02259b tempest-ProjectReaderTests-270232278 None] Lock "cinder-cb04b1b3-609c-4a52-a815-62c195d191f3-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:53 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe 1073741824" returned: 0 in 0.461s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:53 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe Sep 11 23:20:53 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-ab561119-329e-41df-a41f-7cdbedcb9272-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:53 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" returned: 0 in 0.285s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:20:53 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1708be-4e81-4fa0-ae28-84abd1e4e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c6b06f-69f1-49ac-abaf-6c68a084a978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Lock "cinder-ab561119-329e-41df-a41f-7cdbedcb9272-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:54 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Volume volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe (10bb9953-b1c2-4b41-8489-6b3dd8849cfe): created successfully Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c6b06f-69f1-49ac-abaf-6c68a084a978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (76efee38-3028-48e9-a592-72b78392dd3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:54 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0b32b0f3-ecbf-4af1-88fe-156c130eb78f tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Acquiring lock "cinder-quobyte-ab561119-329e-41df-a41f-7cdbedcb9272" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-ab561119-329e-41df-a41f-7cdbedcb9272" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20976e-5d27-4d1e-b250-1a35d0bb560a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:54 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 Sep 11 23:20:54 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:54 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272" returned: 0 in 0.362s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:54 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272 Sep 11 23:20:54 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:54 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-ab561119-329e-41df-a41f-7cdbedcb9272" returned: 0 in 0.267s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Lock "cinder-quobyte-ab561119-329e-41df-a41f-7cdbedcb9272" released by "delete_volume" :: held 0.687s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Created reservations ['a886f894-79a8-45f7-ae9d-a563a7ada0e3', 'cbb2344d-e0e8-46b2-a296-0cfe6611079c', '8e0c2926-2e32-4489-88a0-78c3188140ec', 'faa415a6-90f0-439b-87cd-9517cf0f7c20'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:54 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:54 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:20:54 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:55 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.273s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:20:55 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Deleted volume successfully. Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-4b31402a-17f3-49a9-a7e4-ad347e6d589f tempest-ProjectReaderTests-270232278 None] Lock "cinder-ab561119-329e-41df-a41f-7cdbedcb9272-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot 7f878577-7b22-4a21-a8ff-5d129a43bd1f of volume 10bb9953-b1c2-4b41-8489-6b3dd8849cfe {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14facc33-abd6-4673-9225-bb7cd0d340dd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:55 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe Sep 11 23:20:55 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:55 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" returned: 0 in 0.398s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:55 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:55 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f 1G Sep 11 23:20:55 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:56 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f 1G" returned: 0 in 0.487s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:56 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f Sep 11 23:20:56 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:56 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f" returned: 0 in 0.329s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:56 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f is being set with open permissions: ugo+rw Sep 11 23:20:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:56 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f Sep 11 23:20:56 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:56 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f" returned: 0 in 0.302s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:57 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.info Sep 11 23:20:57 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:57 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.info" returned: 0 in 0.273s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:57 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.info is being set with open permissions: ugo+rw Sep 11 23:20:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:57 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.info Sep 11 23:20:57 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:57 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.info" returned: 0 in 0.267s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:57 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-062af3fd-2c2e-4d80-a25a-9c3a23570103 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-7f878577-7b22-4a21-a8ff-5d129a43bd1f-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-7f878577-7b22-4a21-a8ff-5d129a43bd1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" acquired by "delete_snapshot" :: waited 0.077s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-7f878577-7b22-4a21-a8ff-5d129a43bd1f" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-7f878577-7b22-4a21-a8ff-5d129a43bd1f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot 7f878577-7b22-4a21-a8ff-5d129a43bd1f of volume 10bb9953-b1c2-4b41-8489-6b3dd8849cfe {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e67ee79-6913-43f6-804e-4704a9429267]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:58 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f Sep 11 23:20:58 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:59 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f" returned: 0 in 0.420s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Flow 'volume_create_manager' (8bf0559d-33c0-41c4-92b3-9b78ba38f8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80385b9f-b107-4e36-9029-6e31a263cbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2d6979-fc3e-4637-a3ed-118ed90dd0de]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80385b9f-b107-4e36-9029-6e31a263cbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773813959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30af459f-88b6-4c6f-abc5-4cb1e43344d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8159152f314b3087ed9ab464830814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:59Z,use_quota=True,user_id='06a90079ed154275a4f32eb932135c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b868a48-aa52-4b9d-8d66-7f5f522ecff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b868a48-aa52-4b9d-8d66-7f5f522ecff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab5ef30-55be-4ff2-ac25-559cc4e61351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab5ef30-55be-4ff2-ac25-559cc4e61351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30af459f-88b6-4c6f-abc5-4cb1e43344d9', 'volume_name': 'volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b88e95d-a281-4c05-8dbe-dde0010eba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b88e95d-a281-4c05-8dbe-dde0010eba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973fdef2-da73-4100-8529-4058dcc705c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:20:59 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Volume 30af459f-88b6-4c6f-abc5-4cb1e43344d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9', 'volume_size': 1} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773813959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30af459f-88b6-4c6f-abc5-4cb1e43344d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8159152f314b3087ed9ab464830814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:59Z,use_quota=True,user_id='06a90079ed154275a4f32eb932135c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Creating volume 30af459f-88b6-4c6f-abc5-4cb1e43344d9 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:20:59 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:59 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 1073741824 Sep 11 23:20:59 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:59 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe Sep 11 23:20:59 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:59 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" returned: 0 in 0.362s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:59 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f Sep 11 23:20:59 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:59 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 1073741824" returned: 0 in 0.486s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:59 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 Sep 11 23:20:59 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:20:59 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f" returned: 0 in 0.373s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:20:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:20:59 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f Sep 11 23:20:59 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:00 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9" returned: 0 in 0.274s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973fdef2-da73-4100-8529-4058dcc705c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9495a92-26ce-46f0-9672-e7a46d41656f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:00 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Volume volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 (30af459f-88b6-4c6f-abc5-4cb1e43344d9): created successfully Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9495a92-26ce-46f0-9672-e7a46d41656f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Flow 'volume_create_manager' (8bf0559d-33c0-41c4-92b3-9b78ba38f8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-df2fc277-f8ab-47b9-b330-166f19a066b0 tempest-ProjectReaderTests-1282410727 None] Created volume successfully. Sep 11 23:21:00 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe.7f878577-7b22-4a21-a8ff-5d129a43bd1f" returned: 0 in 0.254s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-7f878577-7b22-4a21-a8ff-5d129a43bd1f" released by "_delete_snapshot" :: held 1.531s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" released by "delete_snapshot" :: held 1.557s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Created reservations ['1625c2be-317d-4b3d-91d6-e8de75b7aec4', '87ff6b69-adc5-4c82-9bae-00743edbbcaa', '25aeeff9-1d11-4139-ad29-980c6151bc36', '79340db6-527a-4c3a-b42e-f6cb8447c4a7'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:00 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-0e759a61-c757-4966-86b8-3bd117334e3e tempest-ProjectMemberTests-1931110376 None] Lock "cinder-7f878577-7b22-4a21-a8ff-5d129a43bd1f-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-10bb9953-b1c2-4b41-8489-6b3dd8849cfe-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-10bb9953-b1c2-4b41-8489-6b3dd8849cfe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b54ef5-a6c6-420d-829b-61c0297b0e49]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:00 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe Sep 11 23:21:00 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:01 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" returned: 0 in 0.367s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:01 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe Sep 11 23:21:01 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Acquiring lock "cinder-30af459f-88b6-4c6f-abc5-4cb1e43344d9-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Lock "cinder-30af459f-88b6-4c6f-abc5-4cb1e43344d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Acquiring lock "cinder-quobyte-30af459f-88b6-4c6f-abc5-4cb1e43344d9" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Lock "cinder-quobyte-30af459f-88b6-4c6f-abc5-4cb1e43344d9" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6f5719-1763-48b5-a7f5-cfc1158f9127]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:01 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" returned: 0 in 0.270s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-10bb9953-b1c2-4b41-8489-6b3dd8849cfe" released by "delete_volume" :: held 0.692s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Created reservations ['ecac0145-c987-4252-b050-86c63e2bb33c', '94c4bb6d-8ef6-49f2-8b29-a02ad1b8b945', 'd7719940-bc67-4e3b-beb6-d5955f8eecb9', '612ddc17-0fb1-4d40-886c-bdde8d309598'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:01 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 Sep 11 23:21:01 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:01 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:21:01 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:01 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9" returned: 0 in 0.371s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:01 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9 Sep 11 23:21:01 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:01 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.282s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:21:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:21:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-92f7aee1-b946-4b15-8a27-00628f511da4 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-10bb9953-b1c2-4b41-8489-6b3dd8849cfe-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:02 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-30af459f-88b6-4c6f-abc5-4cb1e43344d9" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Lock "cinder-quobyte-30af459f-88b6-4c6f-abc5-4cb1e43344d9" released by "delete_volume" :: held 0.687s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Created reservations ['5697e926-28d7-49a6-b5ea-441ab10162ce', '06ef2eca-13e9-4bef-ba33-7c85d3e43056', '17c140b2-baa9-47aa-828e-2cb3b7b65cf3', '8536f581-223f-4ac6-8c6a-abb721f67b4b'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:02 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:21:02 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (1866af2b-7aaf-4390-931f-4f56ab492111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9088363-54c9-4bd5-956b-a159009d52d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9088363-54c9-4bd5-956b-a159009d52d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627141240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd8829b-dd62-4464-9d8c-a8c08486b3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:02Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5100ee-1502-497c-b98b-7d7a7683cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5100ee-1502-497c-b98b-7d7a7683cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340092e0-dffc-4a39-a096-4c46f5aa99f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (340092e0-dffc-4a39-a096-4c46f5aa99f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd8829b-dd62-4464-9d8c-a8c08486b3d5', 'volume_name': 'volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76687f15-261d-44ec-aa2b-29b7f9b5371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76687f15-261d-44ec-aa2b-29b7f9b5371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01e82e0-c2f0-475e-b02e-733e39421ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:02 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Volume 8dd8829b-dd62-4464-9d8c-a8c08486b3d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5', 'volume_size': 1} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1627141240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd8829b-dd62-4464-9d8c-a8c08486b3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:02Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Creating volume 8dd8829b-dd62-4464-9d8c-a8c08486b3d5 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:21:02 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:02 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 1073741824 Sep 11 23:21:02 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:02 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.293s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:21:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Deleted volume successfully. Sep 11 23:21:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c0ca86e6-4739-4cbe-b2bb-c9fafd99e6ad tempest-ProjectReaderTests-1282410727 None] Lock "cinder-30af459f-88b6-4c6f-abc5-4cb1e43344d9-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:03 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 1073741824" returned: 0 in 0.520s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:21:03 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 Sep 11 23:21:03 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Flow 'volume_create_manager' (9a9697f7-3bb7-4d9f-ae4a-fb59fa4ec024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12417a5-fdd2-44a8-bf75-620501e6be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12417a5-fdd2-44a8-bf75-620501e6be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-797905885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5270e046-9e3c-47ce-8354-e3e15c249db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8159152f314b3087ed9ab464830814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:03Z,use_quota=True,user_id='06a90079ed154275a4f32eb932135c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24d649e-bae4-4156-b316-6f9a082b3181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24d649e-bae4-4156-b316-6f9a082b3181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9237f160-1a47-4e38-a761-15f9a092168f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9237f160-1a47-4e38-a761-15f9a092168f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5270e046-9e3c-47ce-8354-e3e15c249db8', 'volume_name': 'volume-5270e046-9e3c-47ce-8354-e3e15c249db8', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed567b-5e68-4746-a767-5b26bdecf8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed567b-5e68-4746-a767-5b26bdecf8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311d437c-d184-465a-8d3a-15d2eb73b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:03 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Volume 5270e046-9e3c-47ce-8354-e3e15c249db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5270e046-9e3c-47ce-8354-e3e15c249db8', 'volume_size': 1} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:03 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" returned: 0 in 0.261s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.163s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-797905885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5270e046-9e3c-47ce-8354-e3e15c249db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8159152f314b3087ed9ab464830814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:03Z,use_quota=True,user_id='06a90079ed154275a4f32eb932135c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Creating volume 5270e046-9e3c-47ce-8354-e3e15c249db8 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:21:03 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01e82e0-c2f0-475e-b02e-733e39421ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:03 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 1073741824 Sep 11 23:21:03 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c9b4ff-6868-4bd4-9d8b-d7a27d1a6322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:03 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Volume volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 (8dd8829b-dd62-4464-9d8c-a8c08486b3d5): created successfully Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c9b4ff-6868-4bd4-9d8b-d7a27d1a6322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (1866af2b-7aaf-4390-931f-4f56ab492111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:03 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-bc1621c1-ca08-48f9-8098-3dfd4a91fa76 tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:21:03 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 1073741824" returned: 0 in 0.447s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:03 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:03 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 Sep 11 23:21:03 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:04 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8" returned: 0 in 0.275s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311d437c-d184-465a-8d3a-15d2eb73b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5270e046-9e3c-47ce-8354-e3e15c249db8', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff25c56-6a69-437b-be1a-6c9fb10a64a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:04 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Volume volume-5270e046-9e3c-47ce-8354-e3e15c249db8 (5270e046-9e3c-47ce-8354-e3e15c249db8): created successfully Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff25c56-6a69-437b-be1a-6c9fb10a64a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Flow 'volume_create_manager' (9a9697f7-3bb7-4d9f-ae4a-fb59fa4ec024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:04 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c8da1520-0834-4b6e-b215-50cf4652ce77 tempest-ProjectReaderTests-1282410727 None] Created volume successfully. Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot 5204ee48-e3f6-49c4-8dc1-24b862117d6e of volume 8dd8829b-dd62-4464-9d8c-a8c08486b3d5 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01af252c-ece0-409b-bbc2-acb8836a28fd]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:04 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:04 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 Sep 11 23:21:04 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:05 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" returned: 0 in 0.374s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:05 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e 1G Sep 11 23:21:05 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Acquiring lock "cinder-5270e046-9e3c-47ce-8354-e3e15c249db8-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Lock "cinder-5270e046-9e3c-47ce-8354-e3e15c249db8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Acquiring lock "cinder-quobyte-5270e046-9e3c-47ce-8354-e3e15c249db8" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Lock "cinder-quobyte-5270e046-9e3c-47ce-8354-e3e15c249db8" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf2612-ef56-49d1-aec3-7493b9a54b66]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:05 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 Sep 11 23:21:05 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:05 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e 1G" returned: 0 in 0.449s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:05 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e Sep 11 23:21:05 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:05 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8" returned: 0 in 0.417s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:05 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8 Sep 11 23:21:05 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:05 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e" returned: 0 in 0.334s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:05 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e is being set with open permissions: ugo+rw Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:05 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e Sep 11 23:21:05 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:05 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-5270e046-9e3c-47ce-8354-e3e15c249db8" returned: 0 in 0.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:05 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Lock "cinder-quobyte-5270e046-9e3c-47ce-8354-e3e15c249db8" released by "delete_volume" :: held 0.729s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Created reservations ['91df8164-ae70-4595-b56f-4121c560bee1', '3e52b252-b7e8-4825-833b-2da88c6a5aa1', '8eb90cbe-18f5-4469-a7d2-ad559a3c39f9', 'b4fe1a33-039d-492d-afef-e730dd8bbcfb'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:06 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e" returned: 0 in 0.299s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:06 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:21:06 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:06 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.info Sep 11 23:21:06 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:06 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.272s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:21:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Deleted volume successfully. Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-1f3bf47b-7faf-4fc1-9b40-518edcca4d7d tempest-ProjectReaderTests-1282410727 None] Lock "cinder-5270e046-9e3c-47ce-8354-e3e15c249db8-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:06 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.info" returned: 0 in 0.292s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:06 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.info is being set with open permissions: ugo+rw Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:06 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.info Sep 11 23:21:06 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:06 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.info" returned: 0 in 0.308s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:06 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-6981becd-cd93-48ed-9a56-72e72034ca67 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Flow 'volume_create_manager' (3d806944-077d-404d-a30f-a87c8fa3aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a25760-ee7d-453f-bd7f-0d7430f5ebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a25760-ee7d-453f-bd7f-0d7430f5ebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567348027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d933eda-e039-48bd-a54a-8c50122e9252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8159152f314b3087ed9ab464830814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:07Z,use_quota=True,user_id='06a90079ed154275a4f32eb932135c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91f1bcd-e0a6-41ba-86c5-829af41922a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91f1bcd-e0a6-41ba-86c5-829af41922a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:06 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21de86a7-e258-4919-9ecf-a3028b9ed563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21de86a7-e258-4919-9ecf-a3028b9ed563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d933eda-e039-48bd-a54a-8c50122e9252', 'volume_name': 'volume-3d933eda-e039-48bd-a54a-8c50122e9252', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe0debb-30b6-49c5-8512-6e7771bd6bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe0debb-30b6-49c5-8512-6e7771bd6bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902b3f77-b501-4534-ab32-ae93795150d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:07 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Volume 3d933eda-e039-48bd-a54a-8c50122e9252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d933eda-e039-48bd-a54a-8c50122e9252', 'volume_size': 1} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567348027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d933eda-e039-48bd-a54a-8c50122e9252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8159152f314b3087ed9ab464830814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:07Z,use_quota=True,user_id='06a90079ed154275a4f32eb932135c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Creating volume 3d933eda-e039-48bd-a54a-8c50122e9252 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:21:07 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:07 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 1073741824 Sep 11 23:21:07 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:07 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 1073741824" returned: 0 in 0.431s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:07 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 Sep 11 23:21:07 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:07 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252" returned: 0 in 0.274s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902b3f77-b501-4534-ab32-ae93795150d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d933eda-e039-48bd-a54a-8c50122e9252', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65985a2-005b-479b-bfe2-826aeef2a1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:07 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Volume volume-3d933eda-e039-48bd-a54a-8c50122e9252 (3d933eda-e039-48bd-a54a-8c50122e9252): created successfully Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65985a2-005b-479b-bfe2-826aeef2a1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Flow 'volume_create_manager' (3d806944-077d-404d-a30f-a87c8fa3aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:07 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-0055c969-23b0-485b-b445-41ca2e3b74e1 tempest-ProjectReaderTests-1282410727 None] Created volume successfully. Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-5204ee48-e3f6-49c4-8dc1-24b862117d6e-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-5204ee48-e3f6-49c4-8dc1-24b862117d6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-5204ee48-e3f6-49c4-8dc1-24b862117d6e" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-5204ee48-e3f6-49c4-8dc1-24b862117d6e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot 5204ee48-e3f6-49c4-8dc1-24b862117d6e of volume 8dd8829b-dd62-4464-9d8c-a8c08486b3d5 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[15be315c-063f-40d7-9d46-a3da36639251]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:07 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:08 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e Sep 11 23:21:08 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:08 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e" returned: 0 in 0.359s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:08 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:21:08 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b463e8-cffc-4431-accd-af7443d6012c]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:08 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 Sep 11 23:21:08 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:08 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" returned: 0 in 0.377s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:08 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:08 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e Sep 11 23:21:08 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:09 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Acquiring lock "cinder-3d933eda-e039-48bd-a54a-8c50122e9252-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e" returned: 0 in 0.385s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Lock "cinder-3d933eda-e039-48bd-a54a-8c50122e9252-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:09 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e Sep 11 23:21:09 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Acquiring lock "cinder-quobyte-3d933eda-e039-48bd-a54a-8c50122e9252" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Lock "cinder-quobyte-3d933eda-e039-48bd-a54a-8c50122e9252" acquired by "delete_volume" :: waited 0.018s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9d4c72-6e46-4701-8221-1af2ba904b53]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:09 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 Sep 11 23:21:09 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:09 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5.5204ee48-e3f6-49c4-8dc1-24b862117d6e" returned: 0 in 0.276s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-5204ee48-e3f6-49c4-8dc1-24b862117d6e" released by "_delete_snapshot" :: held 1.490s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" released by "delete_snapshot" :: held 1.513s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Created reservations ['3ea644fb-a9df-4c37-b619-15b74743c9c1', '22c3ce10-1223-4137-96b6-14780a132f99', '3aed4134-ed9b-42ae-bd7c-045cab75715a', '17290149-ff14-4f51-a114-edca10c395cb'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:09 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-8a180d96-6efe-4ea3-832c-81fefc90df41 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-5204ee48-e3f6-49c4-8dc1-24b862117d6e-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:09 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252" returned: 0 in 0.395s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:09 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252 Sep 11 23:21:09 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:09 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-3d933eda-e039-48bd-a54a-8c50122e9252" returned: 0 in 0.249s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Lock "cinder-quobyte-3d933eda-e039-48bd-a54a-8c50122e9252" released by "delete_volume" :: held 0.688s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:09 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Created reservations ['27da65e7-40cf-4d76-bc01-4a154979b7e1', '4b9fa49c-000c-43d5-a6df-6acad7a540d9', '4d715184-9353-4dd9-b06e-13d969c353c8', '27aadf35-462c-4666-a472-32e99f2e057d'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:10 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:21:10 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-8dd8829b-dd62-4464-9d8c-a8c08486b3d5-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-8dd8829b-dd62-4464-9d8c-a8c08486b3d5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" acquired by "delete_volume" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d78c791-a904-4664-b75a-b9bd711a0601]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:10 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.287s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:21:10 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 Sep 11 23:21:10 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:10 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Deleted volume successfully. Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-cea9ba53-1a55-46da-84a4-318221fad56e tempest-ProjectReaderTests-1282410727 None] Lock "cinder-3d933eda-e039-48bd-a54a-8c50122e9252-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:10 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" returned: 0 in 0.426s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:10 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5 Sep 11 23:21:10 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=193,cinder:INSERT=70,cinder:UPDATE=244,cinder:DELETE=23 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=181,cinder:INSERT=64,cinder:UPDATE=256,cinder:DELETE=19 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Flow 'volume_create_manager' (e13191b2-7fb8-4a42-af2e-996be022d4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763a3ead-a971-4718-b320-70c2bb5ad733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763a3ead-a971-4718-b320-70c2bb5ad733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255277102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8159152f314b3087ed9ab464830814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:11Z,use_quota=True,user_id='06a90079ed154275a4f32eb932135c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee469de-5d4b-4f92-85b9-d3fff34e76a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee469de-5d4b-4f92-85b9-d3fff34e76a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac1aaba-3412-491c-8dc5-172338a88a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac1aaba-3412-491c-8dc5-172338a88a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b', 'volume_name': 'volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e185f1-64b0-400b-8a4c-73a899fb2e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e185f1-64b0-400b-8a4c-73a899fb2e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ba275a-4193-48e9-ad77-622a92fae2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:10 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Volume 8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b', 'volume_size': 1} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255277102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8159152f314b3087ed9ab464830814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:11Z,use_quota=True,user_id='06a90079ed154275a4f32eb932135c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Creating volume 8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:10 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:21:10 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" returned: 0 in 0.297s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:10 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b 1073741824 Sep 11 23:21:10 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-8dd8829b-dd62-4464-9d8c-a8c08486b3d5" released by "delete_volume" :: held 0.783s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:10 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Created reservations ['cba4ec19-d881-4201-907a-529986573d77', '3c15ebfd-721f-4459-a6db-5921fa6dd445', 'f1c46372-7df4-445b-8ed4-26c01b506743', '549c861f-c073-420b-ae5b-3ad556f5ab4f'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:11 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:21:11 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:11 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.272s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:21:11 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-38fa182c-fa5c-4d33-8f13-ba8c32ec09f0 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-8dd8829b-dd62-4464-9d8c-a8c08486b3d5-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:11 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b 1073741824" returned: 0 in 0.496s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:11 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:21:11 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:11 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b Sep 11 23:21:11 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:11 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.292s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:21:11 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b" returned: 0 in 0.319s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ba275a-4193-48e9-ad77-622a92fae2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa977e7f-f85b-4c6a-85be-b4778757e3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (7ea1ce4f-eddf-45aa-8959-637357fc1b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf78bec-5549-4863-851b-5b721f456c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:11 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Volume volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b (8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b): created successfully Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa977e7f-f85b-4c6a-85be-b4778757e3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Flow 'volume_create_manager' (e13191b2-7fb8-4a42-af2e-996be022d4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf78bec-5549-4863-851b-5b721f456c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-660030567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c030884-be07-456d-a954-f6eb1c2d4d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:12Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cb7f83-9101-49ee-a6fb-5822c69c371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cb7f83-9101-49ee-a6fb-5822c69c371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ce3104-2e15-490d-bd3a-4599eff86e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ce3104-2e15-490d-bd3a-4599eff86e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c030884-be07-456d-a954-f6eb1c2d4d1e', 'volume_name': 'volume-0c030884-be07-456d-a954-f6eb1c2d4d1e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffc01f0-8207-425d-94ae-9a573ee03ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cffc01f0-8207-425d-94ae-9a573ee03ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875c078a-2b0e-42ab-bbdd-829854ff346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:11 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Volume 0c030884-be07-456d-a954-f6eb1c2d4d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c030884-be07-456d-a954-f6eb1c2d4d1e', 'volume_size': 1} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-660030567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c030884-be07-456d-a954-f6eb1c2d4d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1212f1631de4ddba873342e590b139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:12Z,use_quota=True,user_id='cc38ff02e05d4b759cde6c8e5d98bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Creating volume 0c030884-be07-456d-a954-f6eb1c2d4d1e {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:21:11 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:21:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:11 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-10e58f3b-e5e5-4679-8929-ca344e4e4d90 tempest-ProjectReaderTests-1282410727 None] Created volume successfully. Sep 11 23:21:11 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e 1073741824 Sep 11 23:21:11 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:12 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e 1073741824" returned: 0 in 0.434s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:12 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e Sep 11 23:21:12 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:12 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e" returned: 0 in 0.257s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875c078a-2b0e-42ab-bbdd-829854ff346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c030884-be07-456d-a954-f6eb1c2d4d1e', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600e2c98-c233-49ac-999e-abe2a639239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:12 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Volume volume-0c030884-be07-456d-a954-f6eb1c2d4d1e (0c030884-be07-456d-a954-f6eb1c2d4d1e): created successfully Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600e2c98-c233-49ac-999e-abe2a639239e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Flow 'volume_create_manager' (7ea1ce4f-eddf-45aa-8959-637357fc1b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:12 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-451cab5c-acee-4af9-81b8-4d4d80e98f39 tempest-ProjectMemberTests-1931110376 None] Created volume successfully. Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Acquiring lock "cinder-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Lock "cinder-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Acquiring lock "cinder-quobyte-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:12 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Lock "cinder-quobyte-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b" acquired by "delete_volume" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30ef0f7-2a34-4aa6-9a51-7bdd9f5c7f83]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:13 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b Sep 11 23:21:13 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:13 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b" returned: 0 in 0.350s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:13 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b Sep 11 23:21:13 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:13 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b" returned: 0 in 0.251s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Lock "cinder-quobyte-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b" released by "delete_volume" :: held 0.642s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Created reservations ['b889e368-517b-462d-8ea8-9a9f88b447f4', '9f65b40d-17de-45cd-9c8e-40071700b9a1', 'fc50e292-dd43-4fac-8152-055a139ebbfb', '1cc3bf9f-6ed5-4282-9e35-a2fd8f1327c4'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:13 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:13 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:21:13 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Creating offline snapshot 9fca7616-8b05-4ea7-83d3-47ffbd50a7ed of volume 0c030884-be07-456d-a954-f6eb1c2d4d1e {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:21:14 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.333s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:21:14 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Deleted volume successfully. Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c69bfe-1292-4d14-b697-b6103597d156]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-73920e50-d18e-4b22-8c95-54207f8fe35d tempest-ProjectReaderTests-1282410727 None] Lock "cinder-8d678d2d-4b36-4e4f-9e2b-f7ec04a6604b-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:14 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e Sep 11 23:21:14 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:14 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e" returned: 0 in 0.390s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:14 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed 1G Sep 11 23:21:14 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:14 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed 1G" returned: 0 in 0.468s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:14 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c030884-be07-456d-a954-f6eb1c2d4d1e -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:14 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c030884-be07-456d-a954-f6eb1c2d4d1e -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed Sep 11 23:21:14 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:15 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c030884-be07-456d-a954-f6eb1c2d4d1e -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed" returned: 0 in 0.378s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:15 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed is being set with open permissions: ugo+rw Sep 11 23:21:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:15 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed Sep 11 23:21:15 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:15 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed" returned: 0 in 0.314s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:15 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:15 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.info Sep 11 23:21:15 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:16 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.info" returned: 0 in 0.317s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:16 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.info is being set with open permissions: ugo+rw Sep 11 23:21:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:16 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.info Sep 11 23:21:16 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:16 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.info" returned: 0 in 0.261s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:16 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:16 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d54dc611-8dcb-45b7-bbd9-bd7dd6722c10 tempest-ProjectMemberTests-1931110376 None] Create snapshot completed successfully Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-9fca7616-8b05-4ea7-83d3-47ffbd50a7ed-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-9fca7616-8b05-4ea7-83d3-47ffbd50a7ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-0c030884-be07-456d-a954-f6eb1c2d4d1e" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-0c030884-be07-456d-a954-f6eb1c2d4d1e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-9fca7616-8b05-4ea7-83d3-47ffbd50a7ed" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-9fca7616-8b05-4ea7-83d3-47ffbd50a7ed" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Deleting offline snapshot 9fca7616-8b05-4ea7-83d3-47ffbd50a7ed of volume 0c030884-be07-456d-a954-f6eb1c2d4d1e {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] snapshot_file for this snap is: volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eba57e-3383-45a9-9859-971c4ae9908a]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:17 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed Sep 11 23:21:17 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:17 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed" returned: 0 in 0.384s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c030884-be07-456d-a954-f6eb1c2d4d1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[264b916a-aae5-4688-8eb5-aba446c43aec]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:17 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:17 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e Sep 11 23:21:17 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:18 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e" returned: 0 in 0.357s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:18 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed Sep 11 23:21:18 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:18 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed" returned: 0 in 0.350s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:18 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed Sep 11 23:21:18 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:18 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e.9fca7616-8b05-4ea7-83d3-47ffbd50a7ed" returned: 0 in 0.255s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-9fca7616-8b05-4ea7-83d3-47ffbd50a7ed" released by "_delete_snapshot" :: held 1.434s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-0c030884-be07-456d-a954-f6eb1c2d4d1e" released by "delete_snapshot" :: held 1.457s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Created reservations ['dd7754ef-a74a-49ee-9321-c352c720b776', 'c4a57926-0afb-4ad2-84db-c0878a1cd54c', 'bc21ceb1-6f99-4ee5-95c0-b1506e006e37', 'aab03844-b356-43a8-8fcc-ea3a0f87454f'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:18 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Delete snapshot completed successfully. Sep 11 23:21:18 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-be62aa63-de2e-46e6-ad44-5fe285ba87c8 tempest-ProjectMemberTests-1931110376 None] Lock "cinder-9fca7616-8b05-4ea7-83d3-47ffbd50a7ed-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-0c030884-be07-456d-a954-f6eb1c2d4d1e-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Lock "cinder-0c030884-be07-456d-a954-f6eb1c2d4d1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Acquiring lock "cinder-quobyte-0c030884-be07-456d-a954-f6eb1c2d4d1e" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:19 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-0c030884-be07-456d-a954-f6eb1c2d4d1e" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:19 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c268af-a0da-4e82-bca7-24b712069115]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:19 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e Sep 11 23:21:19 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:19 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e" returned: 0 in 0.354s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:19 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:19 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e Sep 11 23:21:19 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:20 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-0c030884-be07-456d-a954-f6eb1c2d4d1e" returned: 0 in 0.240s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Lock "cinder-quobyte-0c030884-be07-456d-a954-f6eb1c2d4d1e" released by "delete_volume" :: held 0.647s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Created reservations ['48919718-7fc0-4d14-881d-65dbc79214f2', '80e16048-d680-4d12-9bee-304867911b67', 'a6d6f169-8cf5-4b08-b786-28e1c9a48cb9', '93e42269-1137-43c1-b727-44e328ec09bd'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:20 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:21:20 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:20 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.249s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:21:20 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Deleted volume successfully. Sep 11 23:21:20 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-7b2000fd-f066-47b8-af4e-0686dd8da4cb tempest-ProjectMemberTests-1931110376 None] Lock "cinder-0c030884-be07-456d-a954-f6eb1c2d4d1e-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:30 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=25,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:21:30 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Flow 'volume_create_manager' (f61a6b66-1754-4a6e-8317-d9701963a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ce0cc9-3114-4d88-9fed-dcc212336e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ce0cc9-3114-4d88-9fed-dcc212336e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1419341689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bd42e6-c938-41df-9a76-6c988bf03659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b45eeeae8e408bbebfce59af2ba817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:46Z,use_quota=True,user_id='50fcd10bc821458eae0eb7dd425c7430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8837efd2-4c3e-4028-8d45-2024a8ad9766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8837efd2-4c3e-4028-8d45-2024a8ad9766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d1cfef-cadf-4fab-9fc4-5fbd536dc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d1cfef-cadf-4fab-9fc4-5fbd536dc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bd42e6-c938-41df-9a76-6c988bf03659', 'volume_name': 'volume-f8bd42e6-c938-41df-9a76-6c988bf03659', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1253e546-f2fa-437f-9d9b-a2bdf3fc14ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1253e546-f2fa-437f-9d9b-a2bdf3fc14ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a17c39-3464-4cd6-962f-896605a944c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:46 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Volume f8bd42e6-c938-41df-9a76-6c988bf03659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bd42e6-c938-41df-9a76-6c988bf03659', 'volume_size': 1} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1419341689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bd42e6-c938-41df-9a76-6c988bf03659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b45eeeae8e408bbebfce59af2ba817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:46Z,use_quota=True,user_id='50fcd10bc821458eae0eb7dd425c7430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)}" {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Creating volume f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:21:46 devstack cinder-volume[88026]: INFO cinder.volume.drivers.remotefs [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] casted to osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 1073741824 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:46 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 1073741824 Sep 11 23:21:46 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:46 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 1073741824" returned: 0 in 0.488s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:46 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:46 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 Sep 11 23:21:46 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:47 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659" returned: 0 in 0.261s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:47 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'} {{(pid=88026) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 11 23:21:47 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a17c39-3464-4cd6-962f-896605a944c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bd42e6-c938-41df-9a76-6c988bf03659', 'volume_size': 1}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc54d37-0eee-4894-8075-58750eb0df7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:47 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Volume volume-f8bd42e6-c938-41df-9a76-6c988bf03659 (f8bd42e6-c938-41df-9a76-6c988bf03659): created successfully Sep 11 23:21:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc54d37-0eee-4894-8075-58750eb0df7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:47 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Flow 'volume_create_manager' (f61a6b66-1754-4a6e-8317-d9701963a12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:47 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-85e64019-7694-4e62-a122-be581d439ebc tempest-SnapshotDependencyTests-1864010935 None] Created volume successfully. Sep 11 23:21:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:48 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Creating offline snapshot d69ab6fb-3c30-4804-a3e6-db160839b59b of volume f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 11 23:21:48 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[460ae1cf-23e6-4b90-a946-f4dd3786cfb9]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:48 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 Sep 11 23:21:48 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:48 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659" returned: 0 in 0.372s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:48 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b 1G {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:48 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b 1G Sep 11 23:21:48 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:49 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b 1G" returned: 0 in 0.409s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bd42e6-c938-41df-9a76-6c988bf03659 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:49 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bd42e6-c938-41df-9a76-6c988bf03659 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b Sep 11 23:21:49 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:49 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bd42e6-c938-41df-9a76-6c988bf03659 -F qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b" returned: 0 in 0.301s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:49 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b is being set with open permissions: ugo+rw Sep 11 23:21:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:49 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b Sep 11 23:21:49 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:49 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b" returned: 0 in 0.263s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:49 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:49 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.info Sep 11 23:21:49 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:50 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.info" returned: 0 in 0.274s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:50 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.info is being set with open permissions: ugo+rw Sep 11 23:21:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.info {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:50 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.info Sep 11 23:21:50 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:50 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.info" returned: 0 in 0.296s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:50 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:50 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-d33086d5-d616-423f-9fa6-1a6c4fa3f78d tempest-SnapshotDependencyTests-1864010935 None] Create snapshot completed successfully Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.flows.manager.create_volume [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88026) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Flow 'volume_create_manager' (29c5cb13-b069-4a7f-a57d-5f8fd33feb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f78033-16b2-4a89-ba48-a0d8411fd6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f78033-16b2-4a89-ba48-a0d8411fd6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-11T21:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af604317-6c09-43b5-a96e-d95c55a999cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b45eeeae8e408bbebfce59af2ba817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d69ab6fb-3c30-4804-a3e6-db160839b59b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:51Z,use_quota=True,user_id='50fcd10bc821458eae0eb7dd425c7430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75d975ac-8fbf-4c5c-9093-a75effdfe226),volume_type_id=75d975ac-8fbf-4c5c-9093-a75effdfe226)' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a0abc4-31ba-4350-a81f-531f3ecd6c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a0abc4-31ba-4350-a81f-531f3ecd6c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1164d26-dfe8-496d-b1d7-28711d23f8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1164d26-dfe8-496d-b1d7-28711d23f8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af604317-6c09-43b5-a96e-d95c55a999cc', 'volume_name': 'volume-af604317-6c09-43b5-a96e-d95c55a999cc', 'volume_size': 1, 'snapshot_id': 'd69ab6fb-3c30-4804-a3e6-db160839b59b'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feed4249-cb99-49aa-9a04-cef6d2caa0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feed4249-cb99-49aa-9a04-cef6d2caa0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dacb3ab-031f-40af-af21-3b7ef876410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:51 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Volume af604317-6c09-43b5-a96e-d95c55a999cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af604317-6c09-43b5-a96e-d95c55a999cc', 'volume_size': 1, 'snapshot_id': 'd69ab6fb-3c30-4804-a3e6-db160839b59b'} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-quobyte-d69ab6fb-3c30-4804-a3e6-db160839b59b-af604317-6c09-43b5-a96e-d95c55a999cc" by "_create_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-d69ab6fb-3c30-4804-a3e6-db160839b59b-af604317-6c09-43b5-a96e-d95c55a999cc" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Creating volume af604317-6c09-43b5-a96e-d95c55a999cc from snapshot d69ab6fb-3c30-4804-a3e6-db160839b59b {{(pid=88026) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Selected osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2 as target Quobyte volume. {{(pid=88026) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-quobyte-af604317-6c09-43b5-a96e-d95c55a999cc" by "_copy_volume_from_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-af604317-6c09-43b5-a96e-d95c55a999cc" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] snapshot: d69ab6fb-3c30-4804-a3e6-db160839b59b, volume: af604317-6c09-43b5-a96e-d95c55a999cc, {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eb1923-eb75-4e56-8c01-8d16f544501e]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:51 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b Sep 11 23:21:51 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:51 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b" returned: 0 in 0.416s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8bd42e6-c938-41df-9a76-6c988bf03659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05463d7e-e881-4973-9591-67b5a2317aa5]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:51 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:52 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 Sep 11 23:21:52 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:52 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659" returned: 0 in 0.382s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 11 23:21:52 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Creating direct copy from snapshot {{(pid=88026) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 11 23:21:52 devstack cinder-volume[88026]: DEBUG cinder.utils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Path /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc not found in is_blk_device check {{(pid=88026) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 11 23:21:52 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:52 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc Sep 11 23:21:52 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:56 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc" returned: 0 in 4.175s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG cinder.image.image_utils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Image conversion details: src /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc {{(pid=88026) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 11 23:21:56 devstack cinder-volume[88026]: INFO cinder.image.image_utils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Converted 1024.00 MB image at 245.22 MB/s Sep 11 23:21:56 devstack cinder-volume[88026]: WARNING cinder.volume.drivers.remotefs [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc is being set with open permissions: ugo+rw Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:56 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc Sep 11 23:21:56 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:56 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-af604317-6c09-43b5-a96e-d95c55a999cc" released by "_copy_volume_from_snapshot" :: held 5.323s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-d69ab6fb-3c30-4804-a3e6-db160839b59b-af604317-6c09-43b5-a96e-d95c55a999cc" released by "_create_volume_from_snapshot" :: held 5.391s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.408s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dacb3ab-031f-40af-af21-3b7ef876410c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af604317-6c09-43b5-a96e-d95c55a999cc', 'volume_size': 1, 'snapshot_id': 'd69ab6fb-3c30-4804-a3e6-db160839b59b'}' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10c7175-6088-4249-9415-b96d5ac556ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 11 23:21:56 devstack cinder-volume[88026]: INFO cinder.volume.flows.manager.create_volume [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Volume volume-af604317-6c09-43b5-a96e-d95c55a999cc (af604317-6c09-43b5-a96e-d95c55a999cc): created successfully Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10c7175-6088-4249-9415-b96d5ac556ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88026) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 11 23:21:56 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Flow 'volume_create_manager' (29c5cb13-b069-4a7f-a57d-5f8fd33feb01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88026) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 11 23:21:56 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-eada764a-f38f-4038-b483-00d95ed4fa59 tempest-SnapshotDependencyTests-1864010935 None] Created volume successfully. Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-d69ab6fb-3c30-4804-a3e6-db160839b59b-delete_snapshot" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-d69ab6fb-3c30-4804-a3e6-db160839b59b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-quobyte-f8bd42e6-c938-41df-9a76-6c988bf03659" by "delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-f8bd42e6-c938-41df-9a76-6c988bf03659" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-quobyte-d69ab6fb-3c30-4804-a3e6-db160839b59b" by "_delete_snapshot" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-d69ab6fb-3c30-4804-a3e6-db160839b59b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Deleting offline snapshot d69ab6fb-3c30-4804-a3e6-db160839b59b of volume f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] snapshot_file for this snap is: volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b {{(pid=88026) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb621023-1ffd-4729-9951-be9ddf482415]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:57 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:58 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b Sep 11 23:21:58 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:58 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b" returned: 0 in 0.358s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:58 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.remotefs [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8bd42e6-c938-41df-9a76-6c988bf03659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88026) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 11 23:21:58 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c35356-f92b-4a4f-80f1-f934cf1e1cb4]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:21:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:58 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 Sep 11 23:21:58 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:58 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659" returned: 0 in 0.537s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:58 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:58 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b Sep 11 23:21:58 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:59 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b" returned: 0 in 0.345s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:21:59 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b Sep 11 23:21:59 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:21:59 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 11 23:21:59 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659.d69ab6fb-3c30-4804-a3e6-db160839b59b" returned: 0 in 0.264s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:21:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-d69ab6fb-3c30-4804-a3e6-db160839b59b" released by "_delete_snapshot" :: held 1.605s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-f8bd42e6-c938-41df-9a76-6c988bf03659" released by "delete_snapshot" :: held 1.629s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:21:59 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Created reservations ['1df35d9f-652c-4ca7-a1b7-a85f0fd81354', 'dca907c6-dea1-4457-89e4-6055e9aa3277', '6c262342-42d5-42e0-826e-82ea630e6a0f', '61efdaa7-e315-4f07-812d-b30a297365ea'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:21:59 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Delete snapshot completed successfully. Sep 11 23:21:59 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-c17572f9-3024-4704-b9f2-5fc9bdd96a52 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-d69ab6fb-3c30-4804-a3e6-db160839b59b-delete_snapshot" released by "delete_snapshot" :: held 1.772s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-f8bd42e6-c938-41df-9a76-6c988bf03659-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-f8bd42e6-c938-41df-9a76-6c988bf03659-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-quobyte-f8bd42e6-c938-41df-9a76-6c988bf03659" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-f8bd42e6-c938-41df-9a76-6c988bf03659" acquired by "delete_volume" :: waited 0.016s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fb9ccc-6698-4b50-83fc-812ffa514b2d]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:22:00 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 Sep 11 23:22:00 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:22:00 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659" returned: 0 in 0.345s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:22:00 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659 Sep 11 23:22:00 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:22:00 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-f8bd42e6-c938-41df-9a76-6c988bf03659" returned: 0 in 0.241s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-f8bd42e6-c938-41df-9a76-6c988bf03659" released by "delete_volume" :: held 0.646s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Created reservations ['42aea0f9-cf2a-447b-85d3-0876c8a396df', '0636d934-c5c4-4ba0-bd4f-d73562945197', '03fc2ce5-caf4-4089-9c7a-c6b27dbf97b8', '1894de44-d546-4e2c-8dbe-6ecab5b69e54'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:22:00 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:22:00 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:22:00 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:22:01 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.257s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:22:01 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Deleted volume successfully. Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-3c251a93-f792-44cc-9ca3-125582913438 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-f8bd42e6-c938-41df-9a76-6c988bf03659-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-af604317-6c09-43b5-a96e-d95c55a999cc-delete_volume" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-af604317-6c09-43b5-a96e-d95c55a999cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "cinder-quobyte-af604317-6c09-43b5-a96e-d95c55a999cc" by "delete_volume" {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-af604317-6c09-43b5-a96e-d95c55a999cc" acquired by "delete_volume" :: waited 0.014s {{(pid=88026) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e43ec8-952d-4689-a165-2f09418c5e34]: (4, 'qcow2') {{(pid=89669) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:22:01 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc Sep 11 23:22:01 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:22:01 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc" returned: 0 in 0.387s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:22:01 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:22:01 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc Sep 11 23:22:01 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:22:02 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119/volume-af604317-6c09-43b5-a96e-d95c55a999cc" returned: 0 in 0.265s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-quobyte-af604317-6c09-43b5-a96e-d95c55a999cc" released by "delete_volume" :: held 0.695s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG cinder.quota [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Created reservations ['4d4796d9-4cd5-4eca-bf4c-3b9e27f6b52c', '9aa7c9f9-dc19-47de-9f03-387ee127fd92', 'e09db64a-aa96-4754-8974-2567fab66f1f', '31b96aa5-c7da-4bed-9a16-3390ef66a477'] {{(pid=88026) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:22:02 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:22:02 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:22:02 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.269s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:22:02 devstack cinder-volume[88026]: INFO cinder.volume.manager [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Deleted volume successfully. Sep 11 23:22:02 devstack cinder-volume[88026]: DEBUG cinder.coordination [None req-5f0aceb4-064f-4ac9-bd29-d2c048aa27a4 tempest-SnapshotDependencyTests-1864010935 None] Lock "cinder-af604317-6c09-43b5-a96e-d95c55a999cc-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88026) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2': None} {{(pid=88026) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG cinder.volume.drivers.quobyte [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9e11a091-51a3-44e0-a477-2503a09a02e2'] {{(pid=88026) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.lockutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88026) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 11 23:22:11 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119 Sep 11 23:22:11 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 11 23:22:11 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG oslo_concurrency.processutils [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e38ad988a4667d4fc6c3970dde645119" returned: 0 in 0.266s {{(pid=88026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG cinder.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Notifying Schedulers of capabilities ... {{(pid=88026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG oslo_service.periodic_task [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] Running periodic task VolumeManager._thread_info {{(pid=88026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread count: 28 {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 11 23:22:11 devstack cinder-volume[88026]: DEBUG cinder.volume.manager [None req-fb8b0159-f956-48ac-a4dc-c191125919b9 None None] thread info: [<_MainThread(MainThread, started 128074439315584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 11 23:22:12 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 11 23:22:12 devstack cinder-volume[88026]: DEBUG dbcounter [-] [88026] Writing DB stats cinder:UPDATE=29,cinder:INSERT=10,cinder:DELETE=3,cinder:SELECT=22 {{(pid=88026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}